-- Logs begin at Tue 2022-06-28 11:18:42 UTC, end at Tue 2022-06-28 12:28:24 UTC. -- Jun 28 11:55:51.641749 dv-cinder-847954-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 28 11:55:51.654130 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 28 11:55:51 2022] *** Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: nodename: dv-cinder-847954-1-iscsi Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: machine: x86_64 Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: clock source: unix Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: pcre jit disabled Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: detected number of CPU cores: 4 Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: current working directory: / Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: detected binary path: /usr/bin/uwsgi-core Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: your processes number limit is 47680 Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: your memory page size is 4096 bytes Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: detected max file descriptor number: 2048 Jun 28 11:55:51.657444 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: lock engine: pthread robust mutexes Jun 28 11:55:51.658358 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: thunder lock: enabled Jun 28 11:55:51.658358 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 28 11:55:51.658358 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 28 11:55:51.700890 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: Python main interpreter initialized at 0x55f48b2b99c0 Jun 28 11:55:51.700890 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: python threads support enabled Jun 28 11:55:51.700890 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: your server socket listen backlog is limited to 100 connections Jun 28 11:55:51.700890 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: your mercy for graceful operations on workers is 90 seconds Jun 28 11:55:51.701292 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: mapped 403077 bytes (393 KB) for 2 cores Jun 28 11:55:51.701292 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: *** Operational MODE: preforking *** Jun 28 11:55:51.701584 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: *** uWSGI is running in multiple interpreter mode *** Jun 28 11:55:51.701584 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: spawned uWSGI master process (pid: 103341) Jun 28 11:55:51.701788 dv-cinder-847954-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 28 11:55:51.702349 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: spawned uWSGI worker 1 (pid: 103342, cores: 1) Jun 28 11:55:51.704441 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: spawned uWSGI worker 2 (pid: 103343, cores: 1) Jun 28 11:55:51.704441 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 28 11:55:52.365658 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 11:55:52.369580 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 11:55:53.487707 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 11:55:53.487707 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: from cryptography.utils import int_from_bytes Jun 28 11:55:53.488368 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 11:55:53.488368 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: from cryptography.utils import int_from_bytes Jun 28 11:55:53.492073 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 11:55:53.492073 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: from cryptography.utils import int_from_bytes Jun 28 11:55:53.492534 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 11:55:53.492534 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: from cryptography.utils import int_from_bytes Jun 28 11:55:55.967491 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 11:55:55.968150 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 11:55:55.968412 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 11:55:55.968779 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 11:55:55.969061 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 11:55:55.969454 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.969780 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.970102 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.970421 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.970561 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 11:55:55.970939 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.971032 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 11:55:55.971108 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.971356 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.971504 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 11:55:55.971673 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.971841 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 11:55:55.971953 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 11:55:55.972037 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.972235 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.972345 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.972546 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.972654 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.972870 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847954-1-iscsi {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.972993 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.973218 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.973314 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.973526 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.973626 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.973837 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.973933 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.974155 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.974244 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.974448 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.974532 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.974761 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.974846 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.975021 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.975113 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.975694 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.975917 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.976019 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847954-1-iscsi {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.976324 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.976417 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.976629 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.976716 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.976955 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.977045 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.977273 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.977463 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.977576 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.977646 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.977885 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.977985 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.978186 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.978272 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.978498 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.978687 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.978813 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.979012 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.979137 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.979291 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.979502 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847954-1-iscsi {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.979587 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.979823 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.979931 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.980131 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.980226 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.980442 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.980525 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.980798 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.980895 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.981130 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.981215 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.981452 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.981545 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.981765 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.981908 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.982094 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.982206 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847954-1-iscsi {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.982403 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.982503 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.982731 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.982823 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.983044 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.983142 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.983361 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.983452 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.983729 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.983854 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.984028 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.984340 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.984603 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.984740 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.984947 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.985090 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.985278 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.985397 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.985588 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.985702 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.985920 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.986014 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.986243 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.986329 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.986561 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.986646 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.986878 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.986972 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.987184 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.987279 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.987459 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.987555 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.987689 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.987777 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.988010 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.988108 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.988328 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.988422 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.988642 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.988730 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.988939 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.989040 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.989246 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.989331 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.989567 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.989653 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.989878 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.989975 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.990183 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.990270 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.990433 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.990519 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.990684 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.990779 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.991002 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.991175 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.991321 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.991408 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.991630 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.991725 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.991939 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.992036 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.992242 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.992336 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.992550 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.992677 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.992857 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.992993 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.993189 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.993276 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.993493 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.993586 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.993806 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.993899 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.994120 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.994206 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.994431 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.994516 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.994754 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.994840 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.995061 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.995154 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.995379 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.995471 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.995684 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.995777 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.996006 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.996098 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.996314 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.996407 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.996635 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.996727 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.996885 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.997002 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.997210 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.997308 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.997518 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.997604 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.997836 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.997928 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.998147 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.998256 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.998452 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.998537 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.998756 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.998848 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.999063 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.999185 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.999552 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.999642 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:55.999945 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.000211 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.000320 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.000470 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.000570 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.000776 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.000864 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.001109 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.001210 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.001432 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.001518 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.001740 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.001825 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.002049 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.002156 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.002354 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.002448 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.002656 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.002748 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.002962 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.003057 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.003266 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.003363 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.003573 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.003669 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.003884 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.003977 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.004190 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.004275 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.004492 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.004589 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.004802 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.004956 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.005129 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.005217 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.005437 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.005534 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.005739 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.005837 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.006058 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.006144 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.006363 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.006447 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.006669 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.006765 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.006973 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.007075 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.007274 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.007359 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.007581 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.007675 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.007887 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.007972 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.008193 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.008314 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.008499 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.008594 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.008803 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.008920 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.009127 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.009212 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.009429 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.009515 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.009734 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.009821 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.010041 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.010147 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.010344 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.010435 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.010641 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.010732 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.010951 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.011041 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.011264 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.011355 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.011569 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.011666 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.011872 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.011972 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.012172 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.012270 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.012474 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.012564 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.012777 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.012878 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.013109 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.013199 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.013412 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.013504 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.013719 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.013819 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.014020 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.014110 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.014338 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.014427 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.014659 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.014750 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.015000 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.015179 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.015509 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.015792 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.015891 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.016108 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.016198 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.016434 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:55:56.016524 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.016750 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.016848 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.017100 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.017192 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.017424 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.017514 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.017756 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.017860 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.018075 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.018163 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.018397 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.018487 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.018747 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.018892 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.019054 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.019142 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.019361 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.019521 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.019662 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.019769 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.020060 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.020253 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.020350 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.020431 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.020612 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.020754 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.020916 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.021056 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.021271 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.021405 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.021602 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.021736 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.021921 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.022055 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.022204 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.022303 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.022519 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.022619 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.022828 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.022921 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.023148 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.023253 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.023476 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.023576 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.023792 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.023885 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.024104 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.024205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.024418 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.024510 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.024742 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.024835 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.025085 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.025198 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.025401 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.025494 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.025714 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.025818 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.026027 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.026129 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.026343 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.026437 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.026654 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.026747 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.026971 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.027075 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.027288 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.027383 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.027600 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.027693 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.027909 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.028016 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.028221 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.028315 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.028527 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.028620 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.028834 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.029019 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.029172 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.029312 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.029479 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.029567 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.029785 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.029873 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.030102 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.030187 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.030416 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.030562 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.030832 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.031250 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.031338 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.031576 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.031662 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.031893 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.031995 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.032208 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.032309 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.032523 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.032620 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.032829 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.032957 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.033160 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.033245 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.033468 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.033571 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.033779 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.033867 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.034091 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.034177 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.034402 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.034486 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.034720 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.034807 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.035023 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.035107 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.035346 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.035429 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.035650 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.035759 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.035961 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.036082 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.036272 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.036396 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.036585 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.036712 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.036893 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.037052 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.037226 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.037367 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.037538 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.037693 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.037845 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.038010 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.038169 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.038327 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.038478 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.038665 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.038786 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.038995 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.039109 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.039308 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.039401 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.039635 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.039720 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.039966 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.040060 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.040285 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.040369 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.040594 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.040682 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.040937 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.041044 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.041234 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.041333 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.041538 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.041621 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.041843 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.042018 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.042155 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.042240 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.042458 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.042555 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.042765 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.042877 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.043068 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.043152 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.043373 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.043457 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.043679 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.043766 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.044000 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.044085 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.044309 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.044402 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.044618 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.044704 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.044939 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.045026 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.045247 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.045333 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.045549 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.045643 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.045857 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.045943 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.046186 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.046556 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.046933 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.047025 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.047260 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.047346 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.047579 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.047672 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.047885 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.047971 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.048200 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.048285 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.048506 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.048599 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.048813 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.048913 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.049139 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.049237 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.049444 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.049540 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.049770 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.049861 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.050077 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.050163 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.050398 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.050501 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.050710 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.050808 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.051034 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.051118 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.051342 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.051433 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.051650 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.051735 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.051952 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.052035 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.052258 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.052357 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.052568 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.052662 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.052879 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.053086 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.053207 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.053295 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.053524 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.053624 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.053834 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.053921 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.054149 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.054234 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.054455 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.054538 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.054772 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.054857 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.055081 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.055174 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.055389 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.055481 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.055687 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.055782 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.056000 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.056084 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.056313 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.056398 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.056622 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.056716 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.056970 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.057058 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.057286 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.057369 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.057591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.057689 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.057899 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.057985 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.058204 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.058298 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.058514 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.058612 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.058822 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.058955 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.059131 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.059216 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.059447 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.059575 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.059754 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.059846 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.060069 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.060152 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.060374 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.060466 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.060683 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.060767 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.061017 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.061104 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.061327 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.061413 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.061627 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.061712 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.062035 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.062349 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.062449 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.062661 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.062747 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.062969 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.063067 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.063283 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.063372 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.063594 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.063679 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.063900 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.063993 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.064206 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.064294 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.064518 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.064613 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.064844 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.064953 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.065183 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.065272 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.065503 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.065587 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.065816 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.065901 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.066118 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.066204 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.066424 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.066510 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.066733 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.066818 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.067041 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.067134 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.067347 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.067440 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.067681 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.067828 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.067948 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.068032 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.068251 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.068405 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.068562 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.068671 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.068876 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.069055 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.069210 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.069296 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.069531 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.069661 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.069844 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.069930 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.070148 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.070241 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.070454 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.070554 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.070766 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.070852 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.071075 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.071160 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.071383 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.071479 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.071686 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.071771 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.071992 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.072078 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.072304 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.072389 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.072621 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.072717 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.072991 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.073088 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.073266 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.073353 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.073572 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.073658 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.073887 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.073979 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.074196 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.074287 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.074500 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.074591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.074807 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.074901 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.075124 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.075208 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.075434 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.075697 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.075782 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.076032 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.076125 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.076347 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.076462 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.076654 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.076763 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.076991 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.077090 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.077314 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.077432 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.077704 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.077871 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.078035 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.078380 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.078532 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.078682 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.078848 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.078992 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.079156 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.079301 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.079467 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.079609 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.079788 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.079923 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.080232 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.080354 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.080537 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.080692 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.080842 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.081033 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.081180 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.081355 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.081485 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.081680 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.081790 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.082000 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.082097 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.082332 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.082425 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.082661 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.082746 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.082980 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.083088 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.083294 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.083402 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.083598 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.083684 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.083900 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.083985 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.084211 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.084297 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.084518 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.084604 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.084821 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.084936 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.085149 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.085244 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.085454 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.085540 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.085764 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.085859 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.086065 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.086158 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.086366 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.086465 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.086673 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.086781 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.086974 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.087074 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.087286 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.087372 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.087590 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.087685 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.087899 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.087985 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.088199 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.088286 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.088498 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.088592 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.088808 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.088895 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.089136 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.089279 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.089438 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.089525 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.089738 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.089868 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.090045 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.090130 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.090355 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.090442 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.090665 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.090757 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.090971 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.091057 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.091278 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.091365 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.091581 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.091665 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.091894 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.091993 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.092201 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.092287 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.092503 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.092587 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.092803 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.092896 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.093231 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.093540 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.093731 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.093846 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.094057 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.094155 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.094377 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.094477 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.094685 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.094779 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.094999 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.095095 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.095310 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.095397 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.095619 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.095705 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.095926 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.096014 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.096230 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.096316 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.096529 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.096614 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.096833 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.096949 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.097169 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.097256 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.097477 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.097574 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.097775 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.097868 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.098077 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.098164 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.098379 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.098463 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.098682 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.098770 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.098984 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.099068 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.099292 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.099390 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.099594 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.099688 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.099894 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.099986 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.100197 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.100640 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.100853 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.100986 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.101179 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.101281 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.101483 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.101577 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.101787 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.101873 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.102087 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.102171 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.102391 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.102486 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.102692 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.102777 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.102992 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.103085 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.103292 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.103386 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.103596 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.103680 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.103900 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.103987 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.104201 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.104286 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.104509 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.104596 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.104811 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.104896 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.105154 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.105252 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.105458 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.105544 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.105767 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.105863 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.106073 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.106168 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.106373 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.106459 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.106675 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.106761 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.106986 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.107091 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.107284 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.107378 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.107582 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.107676 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.107881 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.107974 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.108183 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.108269 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.108483 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.108585 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.108842 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.109171 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.109261 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.109475 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.109673 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.109796 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.110021 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.110117 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.110359 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.110447 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.110691 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.110791 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.111030 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.111116 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.111347 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.111446 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.111651 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.111743 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.111962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.112056 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.112273 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.112358 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.112581 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.112677 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.112890 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.113024 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.113223 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.113348 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.113539 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.113679 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.113852 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.114001 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.114165 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.114335 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.114484 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.114666 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.114797 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.114995 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.115102 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.115314 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.115401 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.115630 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.115716 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.115965 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.116049 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.116290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.116376 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.116608 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.116692 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.116995 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.117130 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.117285 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.117371 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.117609 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.117694 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.117924 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.118009 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.118229 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.118323 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.118551 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.118644 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.118871 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.118970 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.119196 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.119281 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.119516 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.119601 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.119841 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.119935 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.120150 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.120234 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.120467 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.120552 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.120780 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.120875 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.121116 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.121220 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.121431 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.121518 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.121752 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.121848 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.122072 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.122158 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.122389 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.122475 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.122723 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.122809 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.123025 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.123109 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.123338 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.123424 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.123654 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.123747 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.123960 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.124045 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.124356 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.124449 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.124670 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.124837 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.125019 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.125312 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.125398 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.125638 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.125807 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.125962 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.126056 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.126279 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.126364 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.126603 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.126690 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.126925 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.127048 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.127255 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.127363 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.127578 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.127674 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.127893 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.127979 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.128299 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.128385 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.128626 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.128722 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.128959 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.129048 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.129277 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.129363 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.129589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.129675 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.129902 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.129988 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.130224 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.130327 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.130541 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.130626 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.130856 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.130942 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.131160 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.131253 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.131471 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.131555 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.131796 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.131880 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.132107 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.132203 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.132426 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.132526 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.132840 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.132973 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.133189 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.133286 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.133499 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.133594 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.133822 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.133916 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.134154 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.134247 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.134462 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.134557 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.134774 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.134861 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.135089 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.135174 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.135398 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.135492 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.135703 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.135796 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.136027 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.136113 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.136334 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.136423 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.136715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.136800 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.137071 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.137161 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.137386 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.137476 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.137696 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.137782 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.138007 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.138093 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.138330 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.138416 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.138638 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.138724 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.138961 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.139061 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.139277 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.139362 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.139601 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.139689 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.139976 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.140105 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.140277 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.140488 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.140587 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.140677 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.140910 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.141015 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.141229 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.141324 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.141539 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.141625 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.141848 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.141944 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.142172 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.142258 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.142484 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.142571 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.142803 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.142891 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.143115 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.143200 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.143434 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.143521 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.143749 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.143836 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.144065 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.144152 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.144378 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.144464 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.144688 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.144775 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.145039 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.145142 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.145355 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.145441 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.145661 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.145751 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.145969 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.146064 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.146281 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.146377 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.146589 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.146675 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.146893 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.146989 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.147198 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.147293 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.147508 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.147594 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.147812 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.147899 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.148117 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.148212 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.148421 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.148507 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.148744 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.148830 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.149095 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.149201 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.149429 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.149515 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.149757 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.149884 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.150065 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.150154 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.150373 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.150523 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.150679 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.150766 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.151021 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.151118 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.151327 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.151422 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.151660 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.151746 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.151975 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.152062 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.152288 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.152381 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.152600 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.152686 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.152922 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.153010 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.153249 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.153336 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.153560 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.153656 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.153873 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.153960 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.154190 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.154276 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.154501 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.154602 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.154811 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.154906 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.155120 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.155215 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.155435 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.155626 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.155888 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.155993 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.156237 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.156334 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.156559 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.156656 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.156877 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.156985 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.157218 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.157497 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.157597 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.157828 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.157914 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.158145 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.158238 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.158460 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.158556 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.158775 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.158871 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.159092 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.159188 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.159406 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.159502 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.159719 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.159807 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.160030 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.160116 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.160341 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.160437 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.160653 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.160743 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.161006 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.161110 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.161329 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.161416 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.161653 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.161739 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.161974 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.162064 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.162290 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.162377 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.162606 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.162691 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.162919 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.163004 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.163235 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.163322 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.163555 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.163640 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.163893 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.164087 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.164209 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.164423 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.164511 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.164745 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.164839 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.165092 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.165194 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.165412 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.165496 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.165733 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.165826 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.166052 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.166140 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.166366 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.166452 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.166676 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.166776 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.166989 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.167085 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.167302 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.167395 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.167616 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.167712 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.167946 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.168060 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.168274 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.168369 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.168589 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.168679 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.168929 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.169031 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.169233 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.169328 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.169548 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.169645 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.169864 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.170068 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.170227 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.170389 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.170728 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.170862 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.171056 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.171163 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.171489 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.171583 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.171809 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.171895 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.172129 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.172226 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.172448 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.172542 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.172766 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.172860 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.173109 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.173197 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.173426 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.173515 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.173744 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.173831 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.174052 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.174137 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.174368 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.174454 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.174681 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.174766 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.174992 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.175088 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.175316 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.175411 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.175628 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.175713 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.175947 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.176160 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.176256 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.176512 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.176776 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.176861 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.177125 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.177225 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.177465 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.177560 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.177796 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.177889 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.178101 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.178195 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.178426 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.178513 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.178741 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.178854 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.179047 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.179169 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.179376 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.179619 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.179708 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.179939 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.180041 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.180246 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.180332 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.180552 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.180639 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.180867 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.180992 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.181206 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.181293 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.181515 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.181603 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.181826 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.181923 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.182134 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.182230 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.182461 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.182673 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.182770 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.183028 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.183114 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.183354 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.183449 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.183667 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.183762 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.183981 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.184067 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.184288 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.184376 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.184596 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.184691 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.184973 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.185065 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.185240 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.185326 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.185548 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.185636 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.185860 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.185951 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.186166 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.186260 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.186475 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.186560 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.186872 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.187031 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.187170 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.187257 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.187490 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.187577 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.187804 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.187891 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.188113 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.188198 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.188421 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.188509 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.188738 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.188825 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.189077 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.189179 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.189390 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.189478 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.189700 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.189785 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.190015 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.190111 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.190324 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.190410 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.190635 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.190728 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.190946 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.191179 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.191267 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.191517 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.191603 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.191840 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.191927 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.192154 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.192249 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.192465 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.192551 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.192783 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.192879 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.193119 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.193220 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.193424 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.193509 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.193748 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.193850 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.194069 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.194156 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.194386 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.194473 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.194695 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.194794 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.195006 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.195093 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.195318 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.195403 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.195625 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.195801 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.195935 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.196022 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.196249 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.196336 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.196561 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.196647 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.196873 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.197016 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.197213 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.197443 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.197543 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.197785 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.197913 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.198111 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.198198 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.198451 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.198553 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.198770 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.198864 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.199093 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.199180 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.199405 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.199493 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.199717 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.199804 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.200026 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.200112 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.200338 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.200425 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.200649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.200735 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.200985 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.201074 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.201304 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.201392 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.201618 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.201704 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.201931 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.202024 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.202236 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.202322 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.202577 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.202713 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.202892 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.203033 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.203209 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.203355 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.203523 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.203681 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.203838 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.203999 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.204154 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.204323 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.204457 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.204647 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.204807 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.204987 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.205162 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.205314 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.205487 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.205628 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.205808 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.205961 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.206130 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.206300 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.206447 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.206629 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.206762 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.206953 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.207076 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.207260 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.207390 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.207566 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.207712 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.207874 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.208045 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.208185 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.208364 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.208508 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.208674 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.208819 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.209123 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.209211 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.209443 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.209545 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.209753 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.209838 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.210059 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.210145 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.210362 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.210457 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.210666 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.210752 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.210970 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.211101 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.211277 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.211365 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.211580 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.211666 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.211884 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.211970 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.212187 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.212275 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.212489 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.212576 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.212791 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.212876 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.213118 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.213213 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.213427 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.213521 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.213734 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.213820 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.214044 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.214140 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.214350 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.214436 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.214655 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.214751 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.214957 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.215050 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.215290 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.215377 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.215603 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.215701 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.215921 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.216006 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.216232 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.216317 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.216541 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.216636 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.216851 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.216955 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.217185 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.217272 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.217499 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.217600 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.217808 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.217894 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.218165 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.218256 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.218478 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.218608 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.218787 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.218876 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.219101 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.219196 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.219410 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.219506 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.219725 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.219812 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.220037 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.220123 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.220348 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.220436 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.220655 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.220741 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.220994 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.221099 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.221304 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.221393 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.221643 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.221729 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.221973 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.222074 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.222290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.222383 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.222610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.222695 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.222924 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.223024 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.223237 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.223323 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.223550 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.223642 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.223876 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.223973 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.224186 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.224272 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.224506 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.224591 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.224819 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.224921 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.225160 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.225246 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.225848 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.225937 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.226166 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.226261 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.226487 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.226576 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.226803 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.226888 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.227115 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.227202 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.227430 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.227515 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.227760 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.227854 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.228089 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.228175 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.228402 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.228495 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.228732 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.228827 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.229084 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.229171 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.229400 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.229485 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.229717 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.229816 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.230026 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.230120 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.230271 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 11:55:56.230358 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.230662 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.230979 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.231301 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.231618 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.231938 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.232258 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.232579 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.232925 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.233266 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.233600 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.234064 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.234536 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.234892 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.235216 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.235569 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.235904 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.236227 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.236548 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.236862 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:55:56.237142 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 11:55:56.292557 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Registered counter for database nova_api Jun 28 11:55:56.298701 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Registered counter for database nova_api Jun 28 11:55:56.409527 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 11:55:56.413172 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 11:55:56.416145 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 11:55:56.419594 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 11:55:56.472369 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.context [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72c723ad-a447-476e-8f04-bf1a1e33d1d5(cell1) {{(pid=103342) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 11:55:56.475956 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.context [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72c723ad-a447-476e-8f04-bf1a1e33d1d5(cell1) {{(pid=103343) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 11:55:56.476712 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 11:55:56.478343 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 11:55:56.479130 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 11:55:56.479920 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 11:55:56.481246 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 11:55:56.481548 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 11:55:56.482350 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 11:55:56.483236 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Registered counter for database nova_cell0 Jun 28 11:55:56.484492 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 11:55:56.486519 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Registered counter for database nova_cell0 Jun 28 11:55:56.487212 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Registered counter for database nova_cell1 Jun 28 11:55:56.490392 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Registered counter for database nova_cell1 Jun 28 11:55:56.497598 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 11:55:56.498345 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 11:55:56.499172 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 11:55:56.503022 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 11:55:56.505712 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 11:55:56.505829 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 11:55:56.507059 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 11:55:56.651347 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 11:55:56.653763 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Registered counter for database nova_cell0 Jun 28 11:55:56.660661 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Registered counter for database nova_cell0 Jun 28 11:55:56.663548 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 11:55:56.668454 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 11:55:56.669713 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 11:55:56.674699 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 11:55:57.003405 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 11:55:57.004682 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 11:55:57.010672 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 11:55:57.012152 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 11:55:57.354464 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 11:55:57.354867 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 11:55:57.360595 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 11:55:57.361228 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 11:55:57.365919 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f48b2b99c0 pid: 103342 (default app) Jun 28 11:55:57.366361 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f48b2b99c0 pid: 103343 (default app) Jun 28 11:55:57.367979 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:55:57.369219 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-972ca7b0-b186-4cdb-8fd4-fa162ae8a973 None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001742 Jun 28 11:55:57.369653 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Tue Jun 28 11:55:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:13.385069 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:13.386996 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002769 Jun 28 11:57:13.387585 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:13.399704 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:13.400548 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell1:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:13.401532 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell0:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:13.402598 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:13.835807 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-a6ec1936-81db-4c5b-9324-06a78159c219 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:13.866725 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-a6ec1936-81db-4c5b-9324-06a78159c219 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.472615 Jun 28 11:57:13.867510 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1291 bytes} [Tue Jun 28 11:57:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:57:15.940889 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:15.942515 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-5ec739a0-9de7-49e6-9114-24195c29acdb None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Jun 28 11:57:15.943201 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 2/4] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:16.012280 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-8417cd37-e7e8-435b-9e0e-44e0bf3de577 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:16.033589 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 11:57:16.033589 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jun 28 11:57:16.063972 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-8417cd37-e7e8-435b-9e0e-44e0bf3de577 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114979 Jun 28 11:57:16.064541 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 3/5] 10.222.0.55 () {64 vars in 1282 bytes} [Tue Jun 28 11:57:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 28 11:57:16.079357 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:16.080704 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell0:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:16.081606 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell1:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:16.082519 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:16.288498 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a927610a-f4a4-4524-b312-517a7a5d872a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:16.290869 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 11:57:16.290869 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 28 11:57:16.354877 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a927610a-f4a4-4524-b312-517a7a5d872a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281969 Jun 28 11:57:16.355668 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 3/6] 10.222.0.55 () {64 vars in 1335 bytes} [Tue Jun 28 11:57:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:57:18.439806 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-8417cd37-e7e8-435b-9e0e-44e0bf3de577 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:18.440829 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-8417cd37-e7e8-435b-9e0e-44e0bf3de577 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 28 11:57:18.441509 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 4/7] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:18.550443 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-1501016b-4eb4-4c34-97eb-078db18d1ac5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:18.568334 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 11:57:18.568334 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 28 11:57:18.586970 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-1501016b-4eb4-4c34-97eb-078db18d1ac5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139370 Jun 28 11:57:18.587530 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 4/8] 10.222.0.55 () {64 vars in 1282 bytes} [Tue Jun 28 11:57:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:18.600086 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-1c2a5f30-bf17-4e0f-b67d-54903fdd087b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:18.601816 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 11:57:18.601816 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jun 28 11:57:18.641814 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-1c2a5f30-bf17-4e0f-b67d-54903fdd087b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045716 Jun 28 11:57:18.642561 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 5/9] 10.222.0.55 () {64 vars in 1335 bytes} [Tue Jun 28 11:57:18 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:57:20.765288 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-1501016b-4eb4-4c34-97eb-078db18d1ac5 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:20.772467 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-1501016b-4eb4-4c34-97eb-078db18d1ac5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.007774 Jun 28 11:57:20.772888 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:20 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:20.835838 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-bcd7f9e7-12e1-4793-a036-e019e42b11ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:20.856059 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-bcd7f9e7-12e1-4793-a036-e019e42b11ab admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076536 Jun 28 11:57:20.863829 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 6/11] 10.222.0.55 () {64 vars in 1282 bytes} [Tue Jun 28 11:57:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 28 11:57:20.869976 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-c31f5879-ca9f-4fcc-9b2d-8915218de278 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:20.893562 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-c31f5879-ca9f-4fcc-9b2d-8915218de278 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027645 Jun 28 11:57:20.904640 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 6/12] 10.222.0.55 () {64 vars in 1335 bytes} [Tue Jun 28 11:57:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 11:57:22.978414 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-bcd7f9e7-12e1-4793-a036-e019e42b11ab admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:22.979566 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-bcd7f9e7-12e1-4793-a036-e019e42b11ab admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Jun 28 11:57:22.980065 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 7/13] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:23.040401 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-ff22045c-2283-4a0d-8c8d-134fa5b9e687 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:23.059100 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-ff22045c-2283-4a0d-8c8d-134fa5b9e687 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072701 Jun 28 11:57:23.059786 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 7/14] 10.222.0.55 () {64 vars in 1282 bytes} [Tue Jun 28 11:57:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:23.071943 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-5ce0ae46-bdd9-4220-be43-bd498f2302c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:23.097526 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-5ce0ae46-bdd9-4220-be43-bd498f2302c9 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029401 Jun 28 11:57:23.098088 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 8/15] 10.222.0.55 () {64 vars in 1335 bytes} [Tue Jun 28 11:57:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:57:25.177434 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-ff22045c-2283-4a0d-8c8d-134fa5b9e687 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:25.178475 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-ff22045c-2283-4a0d-8c8d-134fa5b9e687 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jun 28 11:57:25.178846 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 8/16] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:25.240100 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-afb694f5-eda9-4bab-a559-02d4c6a01ddd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:25.259619 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-afb694f5-eda9-4bab-a559-02d4c6a01ddd admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074782 Jun 28 11:57:25.263192 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 9/17] 10.222.0.55 () {64 vars in 1282 bytes} [Tue Jun 28 11:57:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:25.272423 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-f0ecf0bc-93e4-4e16-8fa8-2ec742f30ea4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:25.297022 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-f0ecf0bc-93e4-4e16-8fa8-2ec742f30ea4 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028427 Jun 28 11:57:25.297579 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 9/18] 10.222.0.55 () {64 vars in 1335 bytes} [Tue Jun 28 11:57:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:57:27.417997 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-afb694f5-eda9-4bab-a559-02d4c6a01ddd admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:27.418935 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-afb694f5-eda9-4bab-a559-02d4c6a01ddd admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 28 11:57:27.419331 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 10/19] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:27.497814 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-0d2c7673-ac09-4391-bbe0-a328cd82e96c admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:27.525541 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-0d2c7673-ac09-4391-bbe0-a328cd82e96c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.099767 Jun 28 11:57:27.526284 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 10/20] 10.222.0.55 () {60 vars in 1291 bytes} [Tue Jun 28 11:57:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 11:57:29.619055 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-afb694f5-eda9-4bab-a559-02d4c6a01ddd admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:29.620457 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-afb694f5-eda9-4bab-a559-02d4c6a01ddd admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002111 Jun 28 11:57:29.621082 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 11/21] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:29.692895 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-738f2efa-b731-45dc-891e-a762fa2bc5f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:29.715963 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-738f2efa-b731-45dc-891e-a762fa2bc5f2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.088466 Jun 28 11:57:29.717052 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 11/22] 10.222.0.55 () {64 vars in 1282 bytes} [Tue Jun 28 11:57:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:29.730109 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-a4d0de7f-83a4-4dd9-9063-4ec594b05562 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:29.755736 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-a4d0de7f-83a4-4dd9-9063-4ec594b05562 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029591 Jun 28 11:57:29.764950 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 12/23] 10.222.0.55 () {64 vars in 1332 bytes} [Tue Jun 28 11:57:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:57:32.115646 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-738f2efa-b731-45dc-891e-a762fa2bc5f2 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:32.117168 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-738f2efa-b731-45dc-891e-a762fa2bc5f2 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002157 Jun 28 11:57:32.117687 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 12/24] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:32.209306 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-efaf27ca-1409-48d7-babf-3b1fb848befb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "ram": 2048, "swap": 0, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:32.234542 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-efaf27ca-1409-48d7-babf-3b1fb848befb admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.107830 Jun 28 11:57:32.235471 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 13/25] 10.222.0.55 () {64 vars in 1282 bytes} [Tue Jun 28 11:57:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:32.250920 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-1bef91d2-a6b4-4c1a-af0d-e510d7d7ba82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:32.279102 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-1bef91d2-a6b4-4c1a-af0d-e510d7d7ba82 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033515 Jun 28 11:57:32.280401 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 13/26] 10.222.0.55 () {64 vars in 1332 bytes} [Tue Jun 28 11:57:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:57:34.394101 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-efaf27ca-1409-48d7-babf-3b1fb848befb admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:34.395188 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-efaf27ca-1409-48d7-babf-3b1fb848befb admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Jun 28 11:57:34.395596 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 14/27] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 11:57:34.467004 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-4014e5ef-9dac-496c-80bb-e49ce1536363 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "id": "3", "swap": 0, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:34.487464 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-4014e5ef-9dac-496c-80bb-e49ce1536363 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.085479 Jun 28 11:57:34.488164 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 14/28] 10.222.0.55 () {64 vars in 1282 bytes} [Tue Jun 28 11:57:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:34.502281 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9d52ed80-27cd-4d43-a067-873090c44f0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:34.528410 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-9d52ed80-27cd-4d43-a067-873090c44f0e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030123 Jun 28 11:57:34.529068 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 15/29] 10.222.0.55 () {64 vars in 1332 bytes} [Tue Jun 28 11:57:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:57:36.755109 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-4014e5ef-9dac-496c-80bb-e49ce1536363 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:36.756117 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-4014e5ef-9dac-496c-80bb-e49ce1536363 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 28 11:57:36.756485 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 15/30] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:36.820077 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-d3827d0a-ab5f-410b-929b-d368c561742f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:36.838282 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-d3827d0a-ab5f-410b-929b-d368c561742f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075623 Jun 28 11:57:36.838821 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 16/31] 10.222.0.55 () {64 vars in 1282 bytes} [Tue Jun 28 11:57:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 28 11:57:36.851484 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-27e0d39b-7250-43b8-9aff-f53b57a9e6df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:36.876308 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-27e0d39b-7250-43b8-9aff-f53b57a9e6df admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028852 Jun 28 11:57:36.876885 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 16/32] 10.222.0.55 () {64 vars in 1332 bytes} [Tue Jun 28 11:57:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:57:38.973811 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-d3827d0a-ab5f-410b-929b-d368c561742f admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:57:38.975085 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-d3827d0a-ab5f-410b-929b-d368c561742f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002125 Jun 28 11:57:38.975737 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 17/33] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:57:39.037012 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9bd425fc-bd6f-4154-b111-7f8bd6428d2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:39.057913 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9bd425fc-bd6f-4154-b111-7f8bd6428d2b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076154 Jun 28 11:57:39.058580 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 17/34] 10.222.0.55 () {64 vars in 1282 bytes} [Tue Jun 28 11:57:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:39.072706 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-1862e724-6ce1-40be-b203-f9e9525b9a0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:57:39.097687 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-1862e724-6ce1-40be-b203-f9e9525b9a0e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030634 Jun 28 11:57:39.099198 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 18/35] 10.222.0.55 () {64 vars in 1332 bytes} [Tue Jun 28 11:57:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:58:03.847195 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9bd425fc-bd6f-4154-b111-7f8bd6428d2b admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:03.849321 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9bd425fc-bd6f-4154-b111-7f8bd6428d2b admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002685 Jun 28 11:58:03.850001 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 18/36] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:58:03.860811 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:03.915057 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-e8c6b10a-bdb3-454f-8c0e-6c2858aabd89 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:03.932052 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-e8c6b10a-bdb3-454f-8c0e-6c2858aabd89 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076033 Jun 28 11:58:03.932582 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 19/37] 10.222.0.55 () {60 vars in 1291 bytes} [Tue Jun 28 11:58:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 11:58:04.864250 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9bd425fc-bd6f-4154-b111-7f8bd6428d2b admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:04.865303 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9bd425fc-bd6f-4154-b111-7f8bd6428d2b admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 28 11:58:04.865704 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 19/38] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 11:58:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:58:05.062735 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-8a1f54c9-ed97-45c0-803e-b206ff5be460 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:05.068617 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-8a1f54c9-ed97-45c0-803e-b206ff5be460 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-8a1f54c9-ed97-45c0-803e-b206ff5be460 admin admin] Request method failure captured: Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Accept: application/json Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Host: 10.222.0.55 Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABiuuzMupJD3HqK6ani40FKQKObDBsNfKoICjGNaqHYUQUpqTNwK4IsnN2TdwuLouKGUrXZ9sxAwkHVswnp1NpiGTx_pKErjsRKo6uGzSQQd9NKU6nEJMRibRnaTvEP98oXKJJUwpznTj_zc_OVZJ8yZqq98XQwGxRP6qfPH7srS8IAxN8 Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Role: admin,member,reader Jun 28 11:58:05.072610 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Roles: admin,member,reader Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}] Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Tenant-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User: admin Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Id: 02f93a0d97354be4b96d139a23cac2ce Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: method: > Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: exception: Flavor 42 could not be found. Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: action_args: {'id': '42'} Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 11:58:05.074335 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:05.075395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:05.077649 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-8a1f54c9-ed97-45c0-803e-b206ff5be460 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 11:58:05.078995 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-8a1f54c9-ed97-45c0-803e-b206ff5be460 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.071636 Jun 28 11:58:05.078995 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 20/39] 10.222.0.55 () {60 vars in 1190 bytes} [Tue Jun 28 11:58:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 28 11:58:05.084080 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-d30415eb-364f-4200-851f-cfab53bc3330 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:05.087160 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:05.107556 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-d30415eb-364f-4200-851f-cfab53bc3330 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027144 Jun 28 11:58:05.108151 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 20/40] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Jun 28 11:58:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 11:58:05.118100 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-0943d79b-f7dd-44b0-916a-bb502961b7ca admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:05.139543 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-0943d79b-f7dd-44b0-916a-bb502961b7ca admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025130 Jun 28 11:58:05.140173 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 21/41] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Jun 28 11:58:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 11:58:05.152533 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-4e8517dc-b9e2-4c71-b23b-0b1fcfe428e3 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:05.160387 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-4e8517dc-b9e2-4c71-b23b-0b1fcfe428e3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-4e8517dc-b9e2-4c71-b23b-0b1fcfe428e3 admin admin] Request method failure captured: Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Accept: application/json Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Host: 10.222.0.55 Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABiuuzMupJD3HqK6ani40FKQKObDBsNfKoICjGNaqHYUQUpqTNwK4IsnN2TdwuLouKGUrXZ9sxAwkHVswnp1NpiGTx_pKErjsRKo6uGzSQQd9NKU6nEJMRibRnaTvEP98oXKJJUwpznTj_zc_OVZJ8yZqq98XQwGxRP6qfPH7srS8IAxN8 Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Role: admin,member,reader Jun 28 11:58:05.165591 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Roles: admin,member,reader Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}] Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Tenant-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User: admin Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Id: 02f93a0d97354be4b96d139a23cac2ce Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: method: > Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: exception: Flavor 42 could not be found. Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: action_args: {'id': '42'} Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 11:58:05.167150 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:05.168231 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:05.169589 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-4e8517dc-b9e2-4c71-b23b-0b1fcfe428e3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 11:58:05.171083 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-4e8517dc-b9e2-4c71-b23b-0b1fcfe428e3 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.020609 Jun 28 11:58:05.171083 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 21/42] 10.222.0.55 () {60 vars in 1190 bytes} [Tue Jun 28 11:58:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 28 11:58:06.003736 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-0943d79b-f7dd-44b0-916a-bb502961b7ca admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:06.005297 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-0943d79b-f7dd-44b0-916a-bb502961b7ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Jun 28 11:58:06.005826 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 22/43] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 11:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:58:06.207944 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-2ecc094f-bba7-4190-98da-b140ec85347a admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:06.214185 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-2ecc094f-bba7-4190-98da-b140ec85347a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-2ecc094f-bba7-4190-98da-b140ec85347a admin admin] Request method failure captured: Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Accept: application/json Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Host: 10.222.0.55 Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABiuuzNofTGY5ssractvCOh58zPW5hZjcb7cda95xL8xItfDvHlf7MopfL1M-nBWV1CNpCFcfdES0wHnkHaKccTVw_sjlntekfKlFObnGwaZ74Oz3Wzjs6FY-WrCF-Xvdh_DDpP7aAKxJEvn4DaHSvCDDPtTHZHDRweRFIXVy12pV08riM Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Role: admin,member,reader Jun 28 11:58:06.215715 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Roles: admin,member,reader Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}] Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Tenant-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User: admin Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Id: 02f93a0d97354be4b96d139a23cac2ce Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: method: > Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: exception: Flavor 84 could not be found. Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: action_args: {'id': '84'} Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 11:58:06.217340 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:06.218214 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:06.219546 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-2ecc094f-bba7-4190-98da-b140ec85347a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 11:58:06.220779 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-2ecc094f-bba7-4190-98da-b140ec85347a admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068173 Jun 28 11:58:06.220779 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 22/44] 10.222.0.55 () {60 vars in 1190 bytes} [Tue Jun 28 11:58:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 11:58:06.227698 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-80e5375f-83e5-4621-aeed-8274c0ea1a41 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:06.241608 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-80e5375f-83e5-4621-aeed-8274c0ea1a41 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017621 Jun 28 11:58:06.242303 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 23/45] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Jun 28 11:58:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 11:58:06.252251 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-91ef2b49-4765-4cc9-8452-804afd2009e0 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:06.267016 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-91ef2b49-4765-4cc9-8452-804afd2009e0 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018294 Jun 28 11:58:06.267584 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 23/46] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Jun 28 11:58:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 11:58:06.284118 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-6f83183e-a3d1-4348-b44d-c66f08f24d93 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:06.290750 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-6f83183e-a3d1-4348-b44d-c66f08f24d93 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-6f83183e-a3d1-4348-b44d-c66f08f24d93 admin admin] Request method failure captured: Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Accept: application/json Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Host: 10.222.0.55 Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABiuuzNofTGY5ssractvCOh58zPW5hZjcb7cda95xL8xItfDvHlf7MopfL1M-nBWV1CNpCFcfdES0wHnkHaKccTVw_sjlntekfKlFObnGwaZ74Oz3Wzjs6FY-WrCF-Xvdh_DDpP7aAKxJEvn4DaHSvCDDPtTHZHDRweRFIXVy12pV08riM Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Role: admin,member,reader Jun 28 11:58:06.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Roles: admin,member,reader Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}] Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Tenant-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User: admin Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Id: 02f93a0d97354be4b96d139a23cac2ce Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: method: > Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: exception: Flavor 84 could not be found. Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: action_args: {'id': '84'} Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 11:58:06.293916 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:06.295004 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:06.296768 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-6f83183e-a3d1-4348-b44d-c66f08f24d93 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 11:58:06.297945 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-6f83183e-a3d1-4348-b44d-c66f08f24d93 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014863 Jun 28 11:58:06.297945 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 24/47] 10.222.0.55 () {60 vars in 1190 bytes} [Tue Jun 28 11:58:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 11:58:07.144330 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-91ef2b49-4765-4cc9-8452-804afd2009e0 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:07.145416 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-91ef2b49-4765-4cc9-8452-804afd2009e0 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jun 28 11:58:07.145815 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 24/48] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 11:58:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:58:07.358486 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-88fd45df-bcfa-4960-a791-8f1abae0ba2b admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:07.364380 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-88fd45df-bcfa-4960-a791-8f1abae0ba2b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-88fd45df-bcfa-4960-a791-8f1abae0ba2b admin admin] Request method failure captured: Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Accept: application/json Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Host: 10.222.0.55 Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABiuuzPfObyNJVuKj7OI8TVf70cREgJzx6Uhn8z87U_piTh4WHheH69xgd_AM6gAFRgO-juBEY-HwcmYn_YxFLgsQN_Z2HvA7qtocb7WwABQ0hObRWH73wVpmvl9f0zDj1-AJ5nKkSnpzuRb23S8jdAou5xk7CKQ8-EIDj69dlxX3xk3Cc Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Role: admin,member,reader Jun 28 11:58:07.365915 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Roles: admin,member,reader Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}] Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Tenant-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User: admin Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Id: 02f93a0d97354be4b96d139a23cac2ce Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: method: > Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: exception: Flavor 451 could not be found. Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: action_args: {'id': '451'} Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 11:58:07.367205 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:07.367962 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jun 28 11:58:07.369002 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-88fd45df-bcfa-4960-a791-8f1abae0ba2b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 11:58:07.370099 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-88fd45df-bcfa-4960-a791-8f1abae0ba2b admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072588 Jun 28 11:58:07.370099 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 25/49] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Jun 28 11:58:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 11:58:07.377924 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9abd2884-7606-4661-89aa-bcfcc0d30503 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:07.393021 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9abd2884-7606-4661-89aa-bcfcc0d30503 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019199 Jun 28 11:58:07.393543 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 25/50] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Jun 28 11:58:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 11:58:07.403072 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:07.418924 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019408 Jun 28 11:58:07.419446 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 26/51] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Jun 28 11:58:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 11:58:07.433071 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-dcec0a10-abb8-4d06-a736-3ceca0e72513 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:07.440898 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-dcec0a10-abb8-4d06-a736-3ceca0e72513 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-dcec0a10-abb8-4d06-a736-3ceca0e72513 admin admin] Request method failure captured: Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Accept: application/json Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Host: 10.222.0.55 Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABiuuzPfObyNJVuKj7OI8TVf70cREgJzx6Uhn8z87U_piTh4WHheH69xgd_AM6gAFRgO-juBEY-HwcmYn_YxFLgsQN_Z2HvA7qtocb7WwABQ0hObRWH73wVpmvl9f0zDj1-AJ5nKkSnpzuRb23S8jdAou5xk7CKQ8-EIDj69dlxX3xk3Cc Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Role: admin,member,reader Jun 28 11:58:07.442998 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Roles: admin,member,reader Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9c70d24580e841bb8af0388fc0999482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9c70d24580e841bb8af0388fc0999482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c70d24580e841bb8af0388fc0999482"}]}] Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Tenant-Id: 9c70d24580e841bb8af0388fc0999482 Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User: admin Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Id: 02f93a0d97354be4b96d139a23cac2ce Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: method: > Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: exception: Flavor 451 could not be found. Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: action_args: {'id': '451'} Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 11:58:07.444290 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:07.445132 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jun 28 11:58:07.446194 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-dcec0a10-abb8-4d06-a736-3ceca0e72513 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 11:58:07.447242 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-dcec0a10-abb8-4d06-a736-3ceca0e72513 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.016985 Jun 28 11:58:07.447242 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 26/52] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Jun 28 11:58:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 11:58:08.291693 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:08.292715 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 28 11:58:08.293144 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 27/53] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 11:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:58:08.499578 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-25aee0ee-4a3c-47b8-b89f-b96c977d1fe2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:58:08.521148 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-25aee0ee-4a3c-47b8-b89f-b96c977d1fe2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.090953 Jun 28 11:58:08.521694 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 27/54] 10.222.0.55 () {64 vars in 1235 bytes} [Tue Jun 28 11:58:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 11:58:09.366633 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:09.367645 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 28 11:58:09.368039 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 28/55] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 11:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:58:09.559447 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-01e9d696-c01f-418c-bc73-dfd02273efff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:58:09.581417 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-01e9d696-c01f-418c-bc73-dfd02273efff admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074454 Jun 28 11:58:09.581888 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 28/56] 10.222.0.55 () {64 vars in 1235 bytes} [Tue Jun 28 11:58:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 11:58:10.425395 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:10.426701 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Jun 28 11:58:10.427192 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 29/57] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 11:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:58:10.631235 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-af7edf21-3a36-4fa2-bbe0-1fa84713d7df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:58:10.651032 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-af7edf21-3a36-4fa2-bbe0-1fa84713d7df admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.085911 Jun 28 11:58:10.651568 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 29/58] 10.222.0.55 () {64 vars in 1235 bytes} [Tue Jun 28 11:58:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 11:58:11.487444 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:11.488423 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 28 11:58:11.488819 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 30/59] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 11:58:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:58:11.688371 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-b2254f6f-8b62-465d-bdbb-2a50cb31d3d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 11:58:11.712110 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-b2254f6f-8b62-465d-bdbb-2a50cb31d3d7 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084484 Jun 28 11:58:11.712762 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 30/60] 10.222.0.55 () {64 vars in 1235 bytes} [Tue Jun 28 11:58:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 11:58:12.545937 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:12.546952 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Jun 28 11:58:12.547337 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 31/61] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 11:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:58:12.746941 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-09d087dd-fe72-4241-8d3f-9b48b961121c admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:58:12.766909 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-09d087dd-fe72-4241-8d3f-9b48b961121c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.081352 Jun 28 11:58:12.767450 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 31/62] 10.222.0.55 () {60 vars in 1202 bytes} [Tue Jun 28 11:58:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 11:59:00.052322 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:59:00.053590 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-44bba41c-3082-4237-8b2f-42a989fa62b8 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001933 Jun 28 11:59:00.054128 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 32/63] 10.222.0.55 () {54 vars in 930 bytes} [Tue Jun 28 11:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 11:59:00.064378 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:00.121847 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-1a6fd836-cda4-4d9e-bcd4-43d3ab4c173e admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:59:00.141451 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-1a6fd836-cda4-4d9e-bcd4-43d3ab4c173e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077954 Jun 28 11:59:00.141978 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 32/64] 10.222.0.55 () {60 vars in 1291 bytes} [Tue Jun 28 11:59:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 11:59:00.165147 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-5d5b9bc9-7f32-48d5-aa85-d9e88de6808d admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:59:00.168711 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=14 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:00.174877 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-5d5b9bc9-7f32-48d5-aa85-d9e88de6808d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013441 Jun 28 11:59:00.175379 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 33/65] 10.222.0.55 () {60 vars in 1282 bytes} [Tue Jun 28 11:59:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:59:00.188791 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-b722ef0d-17ce-448f-b47d-b16191c39bcc admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:59:00.196807 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-b722ef0d-17ce-448f-b47d-b16191c39bcc admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012969 Jun 28 11:59:00.197379 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 33/66] 10.222.0.55 () {60 vars in 1285 bytes} [Tue Jun 28 11:59:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:59:00.209049 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3bab64e6-e2c7-492a-a783-1f43960d93d4 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:59:00.216798 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-3bab64e6-e2c7-492a-a783-1f43960d93d4 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011533 Jun 28 11:59:00.217354 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 34/67] 10.222.0.55 () {60 vars in 1285 bytes} [Tue Jun 28 11:59:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 11:59:00.230404 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-0b595f3d-3cd2-4a51-8736-8d222ec7ec13 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 11:59:00.238332 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-0b595f3d-3cd2-4a51-8736-8d222ec7ec13 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011600 Jun 28 11:59:00.238847 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 34/68] 10.222.0.55 () {60 vars in 1282 bytes} [Tue Jun 28 11:59:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:02:22.798758 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3bab64e6-e2c7-492a-a783-1f43960d93d4 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:02:22.799784 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-3bab64e6-e2c7-492a-a783-1f43960d93d4 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 28 12:02:22.800176 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 35/69] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 12:02:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:02:22.943873 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=6 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:02:23.067460 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-d16104d9-fd98-42c9-ad64-023d96de9aea admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:02:23.068645 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:02:23.068645 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 28 12:02:23.069874 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-d16104d9-fd98-42c9-ad64-023d96de9aea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:02:23.070313 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-d16104d9-fd98-42c9-ad64-023d96de9aea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:02:23.071097 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-d16104d9-fd98-42c9-ad64-023d96de9aea admin admin] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:02:23.071526 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-d16104d9-fd98-42c9-ad64-023d96de9aea admin admin] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:02:23.105853 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-d16104d9-fd98-42c9-ad64-023d96de9aea admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.164189 Jun 28 12:02:23.106411 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 35/70] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Jun 28 12:02:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 12:02:23.930297 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3bab64e6-e2c7-492a-a783-1f43960d93d4 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:02:23.931324 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-3bab64e6-e2c7-492a-a783-1f43960d93d4 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 28 12:02:23.931714 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 36/71] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 12:02:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:02:24.142814 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-fc25bab6-eda6-4c30-ae1e-e59f1852b836 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:02:24.143989 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:02:24.143989 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 28 12:02:24.145184 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-fc25bab6-eda6-4c30-ae1e-e59f1852b836 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:02:24.145618 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-fc25bab6-eda6-4c30-ae1e-e59f1852b836 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:02:24.147023 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-fc25bab6-eda6-4c30-ae1e-e59f1852b836 admin admin] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:02:24.147441 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-fc25bab6-eda6-4c30-ae1e-e59f1852b836 admin admin] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:02:24.167281 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-fc25bab6-eda6-4c30-ae1e-e59f1852b836 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083941 Jun 28 12:02:24.167842 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 36/72] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Jun 28 12:02:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 12:02:35.474848 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3bab64e6-e2c7-492a-a783-1f43960d93d4 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:02:35.475872 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-3bab64e6-e2c7-492a-a783-1f43960d93d4 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 28 12:02:35.476314 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 37/73] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 12:02:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:02:35.622140 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell0:SELECT=4 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:02:35.622894 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell1:SELECT=4 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:02:35.623612 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=8 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:02:35.674142 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-fde4f6ee-9144-47e9-8a46-c452f10967ca admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:02:35.675320 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:02:35.675320 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 28 12:02:35.676508 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-fde4f6ee-9144-47e9-8a46-c452f10967ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:02:35.677010 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-fde4f6ee-9144-47e9-8a46-c452f10967ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:02:35.677785 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-fde4f6ee-9144-47e9-8a46-c452f10967ca admin admin] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:02:35.678246 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-fde4f6ee-9144-47e9-8a46-c452f10967ca admin admin] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:02:35.703858 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-fde4f6ee-9144-47e9-8a46-c452f10967ca admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086761 Jun 28 12:02:35.704306 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 37/74] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Jun 28 12:02:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:02:36.548931 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3bab64e6-e2c7-492a-a783-1f43960d93d4 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:02:36.549959 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-3bab64e6-e2c7-492a-a783-1f43960d93d4 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 28 12:02:36.550356 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 38/75] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Jun 28 12:02:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:02:36.758007 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-f793db20-e76f-4dc2-8405-4e71339fc330 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:02:36.759745 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:02:36.759745 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jun 28 12:02:36.760961 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-f793db20-e76f-4dc2-8405-4e71339fc330 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:02:36.761421 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-f793db20-e76f-4dc2-8405-4e71339fc330 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:02:36.762216 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-f793db20-e76f-4dc2-8405-4e71339fc330 admin admin] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:02:36.762635 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-f793db20-e76f-4dc2-8405-4e71339fc330 admin admin] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:02:36.784545 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-f793db20-e76f-4dc2-8405-4e71339fc330 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.094162 Jun 28 12:02:36.785142 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 38/76] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Jun 28 12:02:36 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:03:35.077540 dv-cinder-847954-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 28 12:03:35.078182 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: Tue Jun 28 12:03:35 2022 - graceful shutdown triggered... Jun 28 12:03:35.078628 dv-cinder-847954-1-iscsi devstack@n-api.service[103343]: Gracefully killing worker 2 (pid: 103343)... Jun 28 12:03:35.078988 dv-cinder-847954-1-iscsi devstack@n-api.service[103342]: Gracefully killing worker 1 (pid: 103342)... Jun 28 12:03:36.079656 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: worker 1 buried after 1 seconds Jun 28 12:03:36.079656 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: worker 2 buried after 1 seconds Jun 28 12:03:36.079656 dv-cinder-847954-1-iscsi devstack@n-api.service[103341]: goodbye to uWSGI. Jun 28 12:03:36.082086 dv-cinder-847954-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 28 12:03:36.082978 dv-cinder-847954-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 28 12:03:36.087100 dv-cinder-847954-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 28 12:03:36.098567 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 28 12:03:36 2022] *** Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: nodename: dv-cinder-847954-1-iscsi Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: machine: x86_64 Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: clock source: unix Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: pcre jit disabled Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: detected number of CPU cores: 4 Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: current working directory: / Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: detected binary path: /usr/bin/uwsgi-core Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: your processes number limit is 47680 Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: your memory page size is 4096 bytes Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: detected max file descriptor number: 2048 Jun 28 12:03:36.100642 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: lock engine: pthread robust mutexes Jun 28 12:03:36.101628 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: thunder lock: enabled Jun 28 12:03:36.101628 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 28 12:03:36.101628 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 28 12:03:36.144802 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: Python main interpreter initialized at 0x55c74c5a79c0 Jun 28 12:03:36.144802 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: python threads support enabled Jun 28 12:03:36.144802 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: your server socket listen backlog is limited to 100 connections Jun 28 12:03:36.144802 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: your mercy for graceful operations on workers is 90 seconds Jun 28 12:03:36.145341 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: mapped 403077 bytes (393 KB) for 2 cores Jun 28 12:03:36.145341 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: *** Operational MODE: preforking *** Jun 28 12:03:36.145584 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: *** uWSGI is running in multiple interpreter mode *** Jun 28 12:03:36.145584 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: spawned uWSGI master process (pid: 117871) Jun 28 12:03:36.145808 dv-cinder-847954-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 28 12:03:36.146388 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: spawned uWSGI worker 1 (pid: 117888, cores: 1) Jun 28 12:03:36.146741 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: spawned uWSGI worker 2 (pid: 117889, cores: 1) Jun 28 12:03:36.148251 dv-cinder-847954-1-iscsi devstack@n-api.service[117871]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 28 12:03:36.811846 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 12:03:36.812506 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 12:03:38.003893 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 12:03:38.003893 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: from cryptography.utils import int_from_bytes Jun 28 12:03:38.004684 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 12:03:38.004684 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: from cryptography.utils import int_from_bytes Jun 28 12:03:38.006029 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 12:03:38.006029 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: from cryptography.utils import int_from_bytes Jun 28 12:03:38.006516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 12:03:38.006516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: from cryptography.utils import int_from_bytes Jun 28 12:03:40.378414 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 12:03:40.378992 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 12:03:40.379287 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 12:03:40.379527 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 12:03:40.379783 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 12:03:40.380000 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 12:03:40.380372 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.380448 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 12:03:40.380526 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.380782 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 12:03:40.380890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.381111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.381194 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 12:03:40.381406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 12:03:40.381505 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.381737 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.381860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.382054 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.382161 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.382375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.382482 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.382695 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.382808 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.383222 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.383451 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.383540 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.383614 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.383700 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847954-1-iscsi {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.383896 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.383999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.384216 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.384316 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.384547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.384662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.384814 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.384942 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.385138 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.385304 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.385449 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847954-1-iscsi {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.385609 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.385760 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.385912 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.386062 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.386273 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.387628 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.387628 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.388082 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.388304 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.388520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.388725 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.388975 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.389217 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.389441 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.389441 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.389876 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.390136 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.390356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.390570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.390791 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.390995 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.391208 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.391431 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.391655 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.391874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.392086 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.392086 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.392634 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847954-1-iscsi {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.392812 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.393043 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.393223 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.393379 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.393540 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.393726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.393883 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.394034 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.394185 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847954-1-iscsi {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.394374 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.394521 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.394683 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.394843 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.394996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.395147 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.395302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.395302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.395586 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.395586 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.395891 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.396034 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.397027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.397204 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.397364 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.397520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.397679 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.397832 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.397988 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.398132 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.398273 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.398479 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.398664 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.398828 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.398972 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.399114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.399440 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.399607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.399751 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.399751 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.400057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.400200 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.400342 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.400491 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.400634 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.400634 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.400983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.401132 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.401274 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.401431 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.401586 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.401586 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.401870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.402021 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.402166 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.402308 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.402465 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.402617 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.402759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.402759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.403055 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.403055 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.403349 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.403493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.403649 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.403800 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.403943 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.404098 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.404252 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.404551 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.404741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.404955 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.405162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.405367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.405555 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.405731 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.405917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.406094 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.406282 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.406788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.406979 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.407166 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.407356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.407356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.407713 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.407713 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.408058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.408212 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.408356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.408356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.408652 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.408805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.408970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.408970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.409261 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.409598 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.409762 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.409762 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.410052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.410052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.410343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.410496 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.410639 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.410639 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.410926 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.411069 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.411210 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.411365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.411509 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.411661 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.411814 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.411814 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.412112 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.412268 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.412418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.412561 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.412702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.412850 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.413046 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.413200 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.413343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.413485 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.413734 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.413734 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.414052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.414052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.414413 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.414566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.414709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.414851 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.415003 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.415147 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.415289 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.415289 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.415560 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.415703 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.415872 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.416024 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.416175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.416327 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.416477 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.416952 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.417129 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.417283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.417440 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.417587 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.417794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.417943 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.418097 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.418256 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.418399 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.418552 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.418707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.418866 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.419016 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.419160 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.419316 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.419460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.419628 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.419947 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.420104 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.420256 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.420424 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.420575 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.420726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.420881 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.421066 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.421066 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.421353 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.421496 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.421646 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.421867 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.422019 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.422169 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.422313 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.422474 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.422626 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.422782 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.422926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.423068 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.423222 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.423375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.423519 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.423674 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.423834 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.423984 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.424135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.424279 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.424445 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.424596 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.424752 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.424894 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.425072 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.425224 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.425377 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.425520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.425670 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.425821 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.425964 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.426275 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.426426 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.426577 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.426745 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.427617 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.427766 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.427921 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.428065 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.428211 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.428362 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.428505 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.428662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.428807 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.429000 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.429159 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.429312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.429466 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.429625 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.429792 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.430058 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.430217 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.430217 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 12:03:40.430524 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.431180 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.431334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.431334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.431628 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.431778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.432114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.432277 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.432423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.432574 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.432718 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.432871 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.433103 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.433248 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.433392 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.433542 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.433705 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.433855 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.434013 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.434156 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.434307 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.434451 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.434601 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.434744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.434895 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.435048 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.435199 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.435351 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.435509 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.435703 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.435856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.436009 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.436154 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.436154 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.436435 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.436587 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.436739 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.437307 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.437484 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.437639 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.437792 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.437948 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.438101 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.438253 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.438396 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.438539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.438690 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.438844 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.438998 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.439142 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.439284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.439284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.439555 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.439705 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.439874 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.440044 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.440290 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.440290 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.440578 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.440721 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.440874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.441051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.441221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.441450 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.441606 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.441760 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.441913 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.442074 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.442224 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.442376 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.442518 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.442669 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.442821 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.442976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.443118 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.443260 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.443401 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.443558 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.443702 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.443843 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.444007 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.444150 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.444317 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.445085 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.445240 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.445384 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.445576 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.445731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.445889 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.446035 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.446176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.446319 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.446471 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.446630 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.446791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.446944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.447247 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.447565 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.447716 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.447867 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.448027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.448171 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.448313 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.448461 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.448605 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.448797 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.448983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.449133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.449275 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.449429 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.449580 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.449739 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.449890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.450040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.450184 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.450326 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.450475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.450697 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.450853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.451001 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.451253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.451403 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.451652 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.451811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.451957 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.452107 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.452302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.452449 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.452709 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.452880 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.453057 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.453212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.453356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.453498 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.453650 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.453801 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.453953 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.454104 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.454246 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.454396 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.454552 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.454695 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.454837 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.454979 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.455137 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.455281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.455433 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.455585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.455727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.455870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.456011 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.456162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.456314 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.456466 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.456619 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.456762 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.456931 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.457096 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.457267 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.457719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.457871 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.458015 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.458158 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.458310 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.458462 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.458614 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.458758 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.458908 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.459058 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.459226 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.459377 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.459521 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.459672 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.459823 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.459966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.460121 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.460264 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.460416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.460567 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.460719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.460875 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.461075 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.461260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.461505 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.461671 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.461903 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.462070 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.462222 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.462365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.462508 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.462508 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.462787 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.462945 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.463088 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.463088 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.463382 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.463382 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.463664 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.463818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.463961 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.464104 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.464247 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.464397 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.464549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.464692 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.464842 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.465025 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.465194 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.465340 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.465495 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.465640 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.465780 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.465931 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.466074 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.466223 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.466374 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.466517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.466666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.466810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.466952 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.467111 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.467273 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.467437 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.467875 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.468026 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.468176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.468329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.468482 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.468626 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.469153 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.469304 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.469446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.469604 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.469769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.469921 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.470072 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.470216 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.470366 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.470518 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.470670 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.470815 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.470963 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.471114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.471258 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.471410 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.471675 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.471834 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.472086 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.472236 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.472380 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.472539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.472692 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.472844 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.473089 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.473244 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.473397 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.473549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.473692 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.473842 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.474006 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.474157 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.474310 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.474461 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.474612 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.474764 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.474907 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.475051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.475213 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.475358 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.475500 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.475642 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.475794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.475945 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.476097 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.476241 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.476383 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.476536 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.476724 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.476916 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.477089 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.477257 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.477404 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.477556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.478033 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.478207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.478360 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.478512 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.478664 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.478809 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.478960 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.479117 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.479268 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.479498 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.479659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.479813 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.479966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.480121 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.480283 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.480435 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.480580 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.480736 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.480879 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.481134 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.481289 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.481433 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.481583 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.481836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.482000 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.482259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.482407 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.482573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.482735 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.482879 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.483035 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.483180 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.483322 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.483473 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.483616 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.483760 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.483917 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.484061 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.484203 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.484352 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.484505 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.484649 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.484801 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.485049 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.485209 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.485355 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.485507 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.485665 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.485815 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.485967 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.486109 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.486260 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.486421 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.486579 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.486722 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.486872 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.486872 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.487183 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.487338 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.487497 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.487649 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.487818 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.488272 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.488418 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.488562 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.488773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.488947 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.489103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.489252 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.489413 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.489413 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.489729 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.489886 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.490037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.490185 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.490341 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.490504 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.490654 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.490820 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.490977 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.491134 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.491284 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.491445 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.491602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.491759 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.492014 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.492171 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.492539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.492743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.492955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.493114 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.493277 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.493466 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.493842 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.494017 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.494177 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.494329 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.494487 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.494645 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.494821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.494981 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.495132 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.495132 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.495437 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.495603 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.495762 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.495912 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.496061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.496061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.496360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.496524 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.496683 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.496841 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.497052 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.497255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.497412 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.497583 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.497742 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.497893 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.498416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.498591 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.498744 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.498901 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.499051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.499234 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.499401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.499559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.499723 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.499921 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.500109 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.500269 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.500429 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.500581 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.500738 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.500889 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.501164 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.501316 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.501466 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.501681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.501838 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.502014 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.502295 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.502451 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.502724 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.502880 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.503039 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.503199 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.503349 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.503505 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.503666 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.503846 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.504089 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.504257 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.504565 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.504749 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.505013 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.505171 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.505322 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.505536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.505696 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.505855 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.506013 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.506164 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.506321 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.506479 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.506638 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.506789 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.506959 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.507740 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.507964 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.508176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.508719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.508719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.509128 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.509288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.509459 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.509613 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.509764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.509922 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.510086 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.510236 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.510396 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.510546 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.510702 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.510853 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.511003 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.511167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.511326 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.511476 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.511625 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.511774 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.511938 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.512110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.512278 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.512534 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.512707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.512997 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.513181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.513349 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.513499 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.513648 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.513805 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.513955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.514202 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.514438 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.514709 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.514875 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.515026 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.515184 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.515349 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.515501 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.515650 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.515800 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.515800 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.516084 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.516248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.516406 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.516565 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.516733 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.516884 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.517131 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.517300 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.517452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.517609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.517774 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.517935 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.518085 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.518248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.518406 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.518406 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.519014 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.519184 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.519344 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.519496 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.519646 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.519795 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.519944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.520101 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.520261 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.520412 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.520563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.520720 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.520871 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.521071 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.521251 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.521412 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.521564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.521723 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.521873 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.522022 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.522238 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.522398 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.522557 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.522726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.522726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.522726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.523384 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.523614 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.523871 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.524083 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.524341 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.524520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.524745 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.525123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.525285 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.525436 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.525586 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.525746 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.525910 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.526072 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.526233 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.526383 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.526533 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.526731 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.526884 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.526884 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.527188 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.527340 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.527500 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.527654 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.527866 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.528020 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.528189 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.528340 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.528498 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.528669 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.529171 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.529338 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.529498 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.529650 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.529823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.529977 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.530125 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.530272 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.530384 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.530493 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.530616 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.530729 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.530846 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.530965 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.531075 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.531075 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.531300 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.531411 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.531528 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.531649 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.531779 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.531918 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.532055 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.532190 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.532318 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.532453 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.532580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.532720 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.532849 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.533172 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.533420 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.533553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.533689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.533830 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.533958 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.534098 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.534235 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.534460 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.534593 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.534744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.534873 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.535002 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.535158 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.535360 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.535506 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.535636 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.535772 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.535903 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.536031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.536161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.536301 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.536432 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.536569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.536706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.536834 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.536975 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.537127 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.537280 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.537531 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.537675 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.537812 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.537948 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.538085 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.538215 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.538343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.538469 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.538604 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.538742 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.538884 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.539390 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.539528 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.539648 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.539648 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.539648 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.540001 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.540112 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.540249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.540385 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.540517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.540652 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.540785 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.540966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.541106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.541241 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.541241 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.541501 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.541635 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.541769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.541903 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.542029 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.542162 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.542295 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.542427 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.542553 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.542684 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.542817 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.543025 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.543025 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.543378 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.543378 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.543734 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.543734 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.543990 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.544119 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.544246 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.544373 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.544577 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.544718 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.544856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.545002 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.545130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.545130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.545402 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.545612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.545612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.545612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.545612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.546102 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.546249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.546410 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.546547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.546547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.546798 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.546925 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.546925 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.547184 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.547324 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.547452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.547579 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.547707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.547707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.547957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.547957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.548196 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.548331 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.548464 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.548600 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.548600 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.548848 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.548992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.549443 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.549588 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.549588 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.549841 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.549976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.550111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.550239 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.550239 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.550563 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.550693 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.550810 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.550925 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.550925 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.550925 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.551299 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.551427 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.551553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.551679 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.551679 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.551938 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.552067 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.552200 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.552328 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.552328 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.552577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.552720 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.552720 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.552720 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.553252 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.553403 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.553403 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.553848 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.553988 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.554126 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.554254 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.554395 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.554523 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.554735 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.554899 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.554899 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.555141 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.555283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.555396 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.555553 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.555553 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.555925 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.556055 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.556197 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.556326 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.556326 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.556572 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.556708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.556708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.556987 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.557128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.557259 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.557387 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.557514 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.557650 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.557650 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.557650 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.558011 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.558139 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.558139 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.558388 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.558526 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.558526 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.558764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.558902 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.559030 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.559167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.559167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.559727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.559856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.559992 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.560130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.560260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.560396 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.560396 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.560659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.560800 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.560994 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.561133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.561133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.561133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.561512 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.561647 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.561647 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.561904 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.562031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.562157 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.562284 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.562284 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.562541 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.562699 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.562914 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.563058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.563058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.563058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.563058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.563058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.563763 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.563994 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.564133 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.564277 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.564414 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.564544 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.564544 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.564544 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.565086 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.565227 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.565357 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.565485 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.565485 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.565740 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.565946 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.565946 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.566214 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.566350 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.566478 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.566607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.566607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.566875 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.567044 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.567174 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.567309 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.567309 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.567567 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.567704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.567839 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.567974 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.567974 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.568224 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.568367 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.568367 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.568609 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.568738 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.568738 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.569068 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.569204 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.569204 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.569607 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.571206 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.571206 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.571544 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.571678 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.571806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.571942 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.571942 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.572192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.572330 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.572330 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.572581 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.572718 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.572845 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.573003 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.573143 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.573282 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.573411 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.573546 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.573546 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.573546 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.574038 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.574250 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.574250 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.574511 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.574639 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.574776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.574986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.574986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.575246 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.575375 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.575375 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.575627 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.575764 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.575892 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.576100 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.576231 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.576358 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.576358 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.576610 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.576737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.576737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.577022 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.577166 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.577302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.577429 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.577429 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.577673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.577808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.577959 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.578087 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.578087 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.578327 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.578453 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.578453 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.578702 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.578830 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.578964 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.579092 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.579092 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.579350 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.579478 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.579478 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.580075 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.580207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.580938 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.581074 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.581216 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.581360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.581360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.581613 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.581749 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.581877 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.582003 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.582003 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.582527 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.582657 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.582792 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.582921 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.583056 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.583195 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.583195 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.583454 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.583583 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.583755 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.583882 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.584057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.584300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.584531 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.584663 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.584799 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.585065 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.585200 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.585328 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.585529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.585668 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.585832 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.586153 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.586296 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.586534 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.586886 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.587148 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.587296 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.587487 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.587694 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.587827 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.588140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.588314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.588588 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.588729 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.588998 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.589131 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.589327 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.589650 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.590117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.590252 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.590379 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.590514 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.590666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.590881 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.590881 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.591198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.591329 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.591509 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.591743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.591875 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.592103 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.592234 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.592447 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.592619 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.592758 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.593064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.593216 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.593354 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.593549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.594281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.594539 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.594777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.594777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.595023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.595427 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.595608 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.595739 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.595877 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.596009 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.596009 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.596234 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.596323 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.596323 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.596577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.596718 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.596942 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.597050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.597247 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.597482 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.597580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.597837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.597929 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.598138 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.598368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.598474 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.598761 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.598852 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.599065 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.599321 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.599422 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.599723 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.599822 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.600029 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.600172 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.600322 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.600648 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.600796 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.600985 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.601125 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.601309 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.601440 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.601619 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.601775 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.602061 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.602412 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.602542 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.602727 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.602926 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.603141 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.603275 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.603459 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.603600 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.603776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.603910 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.604093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.604225 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.604549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.604702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.604838 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.604991 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.605135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.605264 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.605418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.605551 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.605736 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.605880 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.606043 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.606175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.606348 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.606571 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.606711 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.606882 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.607029 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.607214 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.607354 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.607528 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.607660 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.607831 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.607965 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.608134 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.608266 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.608437 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.608571 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.608764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.608894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.609093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.609227 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.609395 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.609527 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.609701 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.609834 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.610007 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.610148 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.610306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.610445 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.610662 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.610796 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.610973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.611119 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.611260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.611398 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.611576 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.611717 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.611878 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.612016 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.612180 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.612401 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.612536 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.612746 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.612880 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.613154 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.613286 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.613416 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.613559 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.613691 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.613832 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.613972 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.614107 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.614274 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.614496 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.614654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.614807 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.614940 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.615112 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.615253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.615431 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.615565 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.615736 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.615878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.616034 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.616270 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.616418 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.616566 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.616706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.616841 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.617707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.617836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.617960 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.618090 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.618090 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.618090 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.618416 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.618537 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.618657 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.618783 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.618904 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.619017 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.619127 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.619245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.619357 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.619503 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.619653 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.619808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.619963 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.620123 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.620254 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.620426 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.620544 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.620799 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.620955 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.621173 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.621482 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.621784 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.622086 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.622388 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.622537 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.622687 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.622836 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.622982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.623112 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.623275 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.623416 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.623575 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.623716 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.623877 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.624017 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.624178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.624319 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.624480 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.624614 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.624808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.624960 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.625188 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.625497 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.625800 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.626181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.626326 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.626459 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.626598 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.626729 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.626874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.627005 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.627141 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.627279 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.627411 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.627540 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.627682 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.627886 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.628007 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.628227 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.628493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.628617 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.628825 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.628952 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.629167 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.629321 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.629497 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.629651 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.629793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.629942 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.630114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.630269 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.630409 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.630557 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.630706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.630853 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.630994 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.631123 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.631353 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.631462 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.631593 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.631695 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.631900 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.632005 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.632204 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.632306 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.632510 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.632603 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.632811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.632977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.633200 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.633409 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.633531 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.633944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.634036 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.634251 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.634356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.634578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.634678 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.634908 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.635050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.635207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.635299 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.635596 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.635701 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.635829 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.635927 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.636154 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.636247 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.636466 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.636558 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.636779 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.636871 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.637091 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.637188 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.637400 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.637512 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.637706 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.637812 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.638015 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.638116 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.638321 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.638420 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.638635 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.638740 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.638948 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.639041 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.639251 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.639354 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.639573 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.639675 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.639898 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.640239 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.640546 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.640870 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.641069 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.641223 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.641450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.641542 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.641761 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.641862 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.642088 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.642194 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.642339 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 12:03:40.642430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.642704 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.643052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.643373 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.643681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.644227 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.644539 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.644867 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.645229 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.645557 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.645882 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.646185 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.646489 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.646790 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.647107 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.647410 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.647717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.648015 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.648319 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.648886 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.649357 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.649664 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.649967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.650267 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.650573 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.650873 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.651173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.651487 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.652061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.652371 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.652672 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.653063 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.653335 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.653641 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.653939 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.654236 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.654533 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.654860 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.655187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.655524 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.655818 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.656122 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.656437 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.656745 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.657084 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.657403 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.657714 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.658019 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.658354 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.658659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.658965 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.659270 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.659572 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.659877 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.660182 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.660528 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.660848 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.661178 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.661497 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.661808 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.662132 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.662442 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.662747 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.663071 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.663375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.663678 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.663985 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.664358 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.664666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.664998 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.665311 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.665628 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.665948 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.666255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.666574 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.666892 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.667230 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.667538 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.667879 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.668201 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.668507 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.668813 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.669138 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 12:03:40.669388 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 12:03:40.703585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO dbcounter [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] Registered counter for database nova_api Jun 28 12:03:40.725307 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_db.sqlalchemy.engines [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 12:03:40.732551 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writer thread running {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 12:03:40.732870 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] Registered counter for database nova_api Jun 28 12:03:40.752976 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 12:03:40.760093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 12:03:40.790613 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.context [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72c723ad-a447-476e-8f04-bf1a1e33d1d5(cell1) {{(pid=117888) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 12:03:40.793441 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:03:40.795075 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:03:40.795899 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:03:40.797914 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:03:40.799970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO dbcounter [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] Registered counter for database nova_cell0 Jun 28 12:03:40.804156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO dbcounter [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] Registered counter for database nova_cell1 Jun 28 12:03:40.811513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_db.sqlalchemy.engines [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 12:03:40.816573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writer thread running {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 12:03:40.818956 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.context [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72c723ad-a447-476e-8f04-bf1a1e33d1d5(cell1) {{(pid=117889) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 12:03:40.823322 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:03:40.824957 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:03:40.825771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:03:40.827745 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:03:40.829816 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] Registered counter for database nova_cell0 Jun 28 12:03:40.833937 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] Registered counter for database nova_cell1 Jun 28 12:03:40.842500 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 12:03:40.844229 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 12:03:40.848541 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 12:03:40.963009 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_db.sqlalchemy.engines [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 12:03:40.967876 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writer thread running {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 12:03:40.979528 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO dbcounter [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] Registered counter for database nova_cell0 Jun 28 12:03:40.986516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_db.sqlalchemy.engines [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 12:03:40.990340 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 12:03:40.991582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writer thread running {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 12:03:41.000628 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] Registered counter for database nova_cell0 Jun 28 12:03:41.007548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 12:03:41.014099 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 12:03:41.308178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: WARNING keystonemiddleware.auth_token [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 12:03:41.315609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: WARNING keystonemiddleware.auth_token [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 12:03:41.331915 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 12:03:41.339381 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 12:03:41.661767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: WARNING keystonemiddleware.auth_token [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 12:03:41.667822 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: WARNING keystonemiddleware.auth_token [None req-369dcf35-b3c7-46d2-9250-71db3933c273 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 12:03:41.673210 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c74c5a79c0 pid: 117888 (default app) Jun 28 12:03:41.686705 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 12:03:41.692790 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-61af8401-5400-4e84-9873-5fc0715b5460 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 12:03:41.698467 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c74c5a79c0 pid: 117889 (default app) Jun 28 12:04:21.989009 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:21.990245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:21.991258 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:21.992316 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:23.981737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cfe81cc1-087f-4c25-bb76-d26e2ca632a8 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Action: 'create', calling method: .version_select at 0x7f3938cc9280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1959797004"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:25.335973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:25.336793 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:25.341710 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:25.345241 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:25.375281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cfe81cc1-087f-4c25-bb76-d26e2ca632a8 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.393554 Jun 28 12:04:25.376835 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1154 bytes} [Tue Jun 28 12:04:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3397 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 28 12:04:25.389648 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-839f2686-b20e-4966-b48f-15a2e66fc550 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938b9e160>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:25.637701 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-839f2686-b20e-4966-b48f-15a2e66fc550 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939" status: 200 len: 345 microversion: 2.1 time: 0.250131 Jun 28 12:04:25.638440 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 2/2] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:04:25 2022] GET /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939 => generated 345 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:04:25.857968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5dddcbdc-f36d-4fa0-8dde-9ec40611103a tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] Calling method '.version_select at 0x7f3938d87f70>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:26.313706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5dddcbdc-f36d-4fa0-8dde-9ec40611103a tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/8cdc1442-7cba-4f87-93c5-917450d6927d" status: 200 len: 351 microversion: 2.1 time: 0.982871 Jun 28 12:04:26.314968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 1/3] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:04:25 2022] GET /compute/v2.1/os-volumes/8cdc1442-7cba-4f87-93c5-917450d6927d => generated 351 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:26.651787 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-21b162b2-4cdd-456e-a1df-dddb99cfa7d8 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938b9e4c0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:26.844721 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-21b162b2-4cdd-456e-a1df-dddb99cfa7d8 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939" status: 200 len: 346 microversion: 2.1 time: 0.197905 Jun 28 12:04:26.845327 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 3/4] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:04:26 2022] GET /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939 => generated 346 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:04:26.857142 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bf5683b2-d567-4c1d-a533-d89019bd209f tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Action: 'create', calling method: .version_select at 0x7f3938b8e0d0>, body: {"snapshot": {"volume_id": "60ac236a-140f-495b-840a-ff2918717939", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1980658131"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:27.743446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bf5683b2-d567-4c1d-a533-d89019bd209f tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.890485 Jun 28 12:04:27.744040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 2/5] 10.222.0.55 () {60 vars in 1161 bytes} [Tue Jun 28 12:04:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:27.754361 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5dabcfd7-b651-4eee-baaa-96b2a12a9f42 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938b9e8b0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:27.915800 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5dabcfd7-b651-4eee-baaa-96b2a12a9f42 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.165279 Jun 28 12:04:27.920942 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 4/6] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:27 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:27.926979 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-11fd89c5-be4e-4105-8d33-e25629b83738 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938b8e940>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:28.015690 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-11fd89c5-be4e-4105-8d33-e25629b83738 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.093008 Jun 28 12:04:28.016968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 3/7] 10.222.0.55 () {58 vars in 1139 bytes} [Tue Jun 28 12:04:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:28.029394 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c65cde70-182d-49d6-8b7d-80d7acccd693 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938b29040>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:28.106039 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c65cde70-182d-49d6-8b7d-80d7acccd693 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.070738 Jun 28 12:04:28.106039 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 5/8] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:28 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:28.990466 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c8ea2d5c-6be6-4ed6-be0a-dc3ff9711612 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] Calling method '.version_select at 0x7f3938b8edc0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:29.111590 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b3d641cf-45f5-49ee-a1a8-ed5c10854c0a tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938b9ec10>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:29.127579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c8ea2d5c-6be6-4ed6-be0a-dc3ff9711612 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/1f46a398-238c-49cc-91e0-921ad1fc0bc3" status: 200 len: 351 microversion: 2.1 time: 0.140955 Jun 28 12:04:29.128024 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 4/9] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:04:28 2022] GET /compute/v2.1/os-volumes/1f46a398-238c-49cc-91e0-921ad1fc0bc3 => generated 351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:29.185200 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b3d641cf-45f5-49ee-a1a8-ed5c10854c0a tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.077249 Jun 28 12:04:29.185767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 6/10] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:29 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:30.203881 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7567d049-5f53-4ca8-90c6-5690658502b5 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938b9b550>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:30.269261 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7567d049-5f53-4ca8-90c6-5690658502b5 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.076051 Jun 28 12:04:30.270519 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 5/11] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:30 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:31.272006 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-387503421", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "networks": [{"uuid": "6277b8b7-5d64-47db-957f-ee0c9a83a011"}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:31.283716 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-189b8d1f-40c6-4245-9245-81f3ccab0ca9 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938b8e280>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:31.339979 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-189b8d1f-40c6-4245-9245-81f3ccab0ca9 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.062173 Jun 28 12:04:31.340588 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:31 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:31.408856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] validate_networks() for [('6277b8b7-5d64-47db-957f-ee0c9a83a011', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:04:32.352007 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5ec79765-505f-4e89-af96-6a3dd784e839 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938b8e700>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:32.407156 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5ec79765-505f-4e89-af96-6a3dd784e839 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.059332 Jun 28 12:04:32.408204 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:32 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:33.419527 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b345f78d-5039-4d13-a5bd-bc6e0018bd8a tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3939505820>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:33.476468 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b345f78d-5039-4d13-a5bd-bc6e0018bd8a tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.060906 Jun 28 12:04:33.480635 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 8/14] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:33 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:34.034874 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:04:34.037994 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:04:34.038721 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:04:34.039295 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:04:34.040188 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:04:34.069891 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:34.076889 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:34.078259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:34.078883 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:34.146348 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Getting quotas for project e1632e95c1054b4e89203492e13ad3b7. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:04:34.157989 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Getting quotas for user d6275dbb33b544dcb91453a858073606 and project e1632e95c1054b4e89203492e13ad3b7. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:04:34.189401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:04:34.201195 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:04:34.370630 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-82762003-bb80-42b1-8de3-7e02e4c1d79f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.317170 Jun 28 12:04:34.376431 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 7/15] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:04:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:04:34.382090 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f1dd4776-f03d-498c-b42b-3c5d4f45371e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:34.385512 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f1dd4776-f03d-498c-b42b-3c5d4f45371e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:34.488383 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-42e03c31-a310-4b45-b999-af87f631a4a7 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938a91d30>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:34.547202 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-42e03c31-a310-4b45-b999-af87f631a4a7 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.063160 Jun 28 12:04:34.548792 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 8/16] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:34 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:34.629388 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f1dd4776-f03d-498c-b42b-3c5d4f45371e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:34.668055 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f1dd4776-f03d-498c-b42b-3c5d4f45371e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1214 microversion: 2.1 time: 0.289013 Jun 28 12:04:34.673596 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 9/17] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:34 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1214 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:35.577083 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2c1b89f0-2b11-41e4-b39f-b751f2a56a5b tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f39382374c0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:35.649492 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2c1b89f0-2b11-41e4-b39f-b751f2a56a5b tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 288 microversion: 2.1 time: 0.092538 Jun 28 12:04:35.655038 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 9/18] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:35 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:35.660324 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e02dcc6c-6ee0-413b-acaa-162ec6f72a1b tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938bceee0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:35.689722 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0963e631-4777-42ab-958e-acf25ccf698b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:35.690346 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0963e631-4777-42ab-958e-acf25ccf698b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:35.887051 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e02dcc6c-6ee0-413b-acaa-162ec6f72a1b tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 202 len: 0 microversion: 2.1 time: 0.230560 Jun 28 12:04:35.887844 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 10/19] 10.222.0.55 () {58 vars in 1253 bytes} [Tue Jun 28 12:04:35 2022] DELETE /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:04:35.896745 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fc368be8-e13e-47ce-944a-33365b062c7a tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938b5ce50>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:35.951755 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fc368be8-e13e-47ce-944a-33365b062c7a tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.059035 Jun 28 12:04:35.952867 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 11/20] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:35 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:04:36.386523 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0963e631-4777-42ab-958e-acf25ccf698b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:36.486936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0963e631-4777-42ab-958e-acf25ccf698b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1214 microversion: 2.1 time: 0.800907 Jun 28 12:04:36.497303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 10/21] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:35 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1214 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:36.964800 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dfe00e12-8292-43c5-a1ed-88b05d8554ce tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938b61550>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:37.046950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dfe00e12-8292-43c5-a1ed-88b05d8554ce tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.085877 Jun 28 12:04:37.055964 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 12/22] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:36 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:37.512515 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ad744e23-ba6b-4207-8da5-4146bd32160e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:37.513938 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ad744e23-ba6b-4207-8da5-4146bd32160e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:37.524279 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad744e23-ba6b-4207-8da5-4146bd32160e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:37.526126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad744e23-ba6b-4207-8da5-4146bd32160e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:37.536138 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad744e23-ba6b-4207-8da5-4146bd32160e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:37.537080 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad744e23-ba6b-4207-8da5-4146bd32160e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:37.801133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ad744e23-ba6b-4207-8da5-4146bd32160e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:37.826532 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ad744e23-ba6b-4207-8da5-4146bd32160e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1218 microversion: 2.1 time: 0.313275 Jun 28 12:04:37.836848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 11/23] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:37 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1218 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:38.135065 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-638099505", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:38.294497 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e739bee8-194d-4bcf-8dff-bd656777a185 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Action: 'create', calling method: .version_select at 0x7f39381cf4c0>, body: {"keypair": {"name": "tempest-keypair-1349213626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQqphoKrdjxiABkgq9MqswQgYAXJ/NQN0tEQ9ebicbWx/6CBfeCWXiMwEwjoVePPFWnL0c653gSDCeD50C4YB1Ngv+oxOAxj3k5wlcMXI7IgtG379lZvYemmiAH5qElSA=="}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:38.327014 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-e739bee8-194d-4bcf-8dff-bd656777a185 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Getting quotas for project cb27799cde2e4258a2eedc5bda555c61. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:04:38.351143 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-e739bee8-194d-4bcf-8dff-bd656777a185 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Getting quotas for user 702dcd49668c4680b5bf3c1c75575ab7 and project cb27799cde2e4258a2eedc5bda555c61. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:04:38.355844 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] validate_networks() for [('53ee723f-205c-4be8-bee6-2b68e9be82de', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:04:38.483316 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e739bee8-194d-4bcf-8dff-bd656777a185 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.554024 Jun 28 12:04:38.484694 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 12/24] 10.222.0.55 () {62 vars in 1199 bytes} [Tue Jun 28 12:04:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 556 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 28 12:04:38.498270 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d917d93a-f76c-496b-88ae-c48544ec515a tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f39381ddee0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:38.537124 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d917d93a-f76c-496b-88ae-c48544ec515a tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.050670 Jun 28 12:04:38.543661 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 13/25] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:38 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:38.669933 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5aedf117-2190-4795-b5ea-f0bd051b9f39 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Action: 'create', calling method: .version_select at 0x7f393816a0d0>, body: {"keypair": {"name": "tempest-keypair-870893037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmRJrgYSnPFqwMOGpdde3dfm6kHRkPCXJrq2ndWMwd3JCu4LJ0NXlVNbEoxOiHqDx8XjrBvOF7K+M46ncPhLZPLTMuvp9UhWUbJRMwUBfRtAv5lhM19LO6z2o1St4bd1g=="}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:38.697926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-5aedf117-2190-4795-b5ea-f0bd051b9f39 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Getting quotas for project 73679a9c1e1140dab3237b74ff50d3c8. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:04:38.719439 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-5aedf117-2190-4795-b5ea-f0bd051b9f39 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Getting quotas for user b8d8d0c23f744a7b9ad311581f6ae39f and project 73679a9c1e1140dab3237b74ff50d3c8. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:04:38.759333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5aedf117-2190-4795-b5ea-f0bd051b9f39 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.154425 Jun 28 12:04:38.760611 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 14/26] 10.222.0.55 () {60 vars in 1158 bytes} [Tue Jun 28 12:04:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:38.848152 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-225374a3-4d19-4918-b777-c096b4452e3b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:38.849938 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-225374a3-4d19-4918-b777-c096b4452e3b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:38.861257 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-225374a3-4d19-4918-b777-c096b4452e3b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:38.863060 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-225374a3-4d19-4918-b777-c096b4452e3b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:38.864198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-225374a3-4d19-4918-b777-c096b4452e3b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:38.864887 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-225374a3-4d19-4918-b777-c096b4452e3b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:38.989565 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-225374a3-4d19-4918-b777-c096b4452e3b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:39.006712 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-225374a3-4d19-4918-b777-c096b4452e3b tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1210 microversion: 2.1 time: 0.164058 Jun 28 12:04:39.016788 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 15/27] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:38 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1210 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:39.554511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-08712f47-84a0-456a-97f8-8b833318eaeb tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f39381dd040>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:39.621592 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-08712f47-84a0-456a-97f8-8b833318eaeb tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 200 len: 287 microversion: 2.1 time: 0.072512 Jun 28 12:04:39.622040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 16/28] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:39 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:04:39.946408 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-398f0707-51ff-46ed-b301-ef3e5ad00195 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] Calling method '.version_select at 0x7f39381420d0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:40.089643 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-398f0707-51ff-46ed-b301-ef3e5ad00195 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d4d121a5-f8a1-4837-9fda-4f4aa05f0961" status: 200 len: 349 microversion: 2.1 time: 0.148778 Jun 28 12:04:40.090277 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 17/29] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:04:39 2022] GET /compute/v2.1/os-volumes/d4d121a5-f8a1-4837-9fda-4f4aa05f0961 => generated 349 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:40.103809 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-dfafffa9-cdb5-45e8-ab50-d1357a7b6949 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:40.106478 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-dfafffa9-cdb5-45e8-ab50-d1357a7b6949 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:40.138002 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dfafffa9-cdb5-45e8-ab50-d1357a7b6949 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:40.138459 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dfafffa9-cdb5-45e8-ab50-d1357a7b6949 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:40.139249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dfafffa9-cdb5-45e8-ab50-d1357a7b6949 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:40.139694 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dfafffa9-cdb5-45e8-ab50-d1357a7b6949 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:40.470050 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dfafffa9-cdb5-45e8-ab50-d1357a7b6949 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:40.480690 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-dfafffa9-cdb5-45e8-ab50-d1357a7b6949 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1272 microversion: 2.1 time: 0.381377 Jun 28 12:04:40.494202 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 18/30] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:40 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1272 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:40.529640 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cd5bace5-7d1b-4ab6-807f-2db28bf1efc0 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] Calling method '.version_select at 0x7f393816a1f0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:40.886233 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cd5bace5-7d1b-4ab6-807f-2db28bf1efc0 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.390146 Jun 28 12:04:40.895164 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 19/31] 10.222.0.55 () {58 vars in 1133 bytes} [Tue Jun 28 12:04:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:40.900810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-46c9a82d-b0b6-42f1-9b85-6ba38b2ee3b9 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938151d30>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:40.973981 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-46c9a82d-b0b6-42f1-9b85-6ba38b2ee3b9 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] HTTP exception thrown: Snapshot 7311bbcd-41c6-48bf-ab0d-17e014e9440c could not be found. Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-46c9a82d-b0b6-42f1-9b85-6ba38b2ee3b9 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Request method failure captured: Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c HTTP/1.1 Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5FgNSXLfiz-Ze0MoSiU2VsdVvUWgXUNFd_h1UGihlfJxqGLzfKsJ7un_XLyrRzAgRkcDBtcc0kwEFJuPy0LJ14kIQC3Ts0Sjc00CgMcMLPnXKBLXu6l7BWtztE3bEJ_jcsNtyItN1XoTLfk_rOc9rwP3VqjtOqIAvvzQxJJ385lQc Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 9093a24833e6400098728603fb9e8306 Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:04:40.978128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9093a24833e6400098728603fb9e8306"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9093a24833e6400098728603fb9e8306"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9093a24833e6400098728603fb9e8306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9093a24833e6400098728603fb9e8306"}]}] Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 9093a24833e6400098728603fb9e8306 Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesSnapshotsTestJSON-73310748-project Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 187b061de2574e6d9a42584042f2c71e Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesSnapshotsTestJSON-73310748-project Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Snapshot 7311bbcd-41c6-48bf-ab0d-17e014e9440c could not be found. Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '7311bbcd-41c6-48bf-ab0d-17e014e9440c'} Jun 28 12:04:40.979343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7311bbcd-41c6-48bf-ab0d-17e014e9440c could not be found. (HTTP 404) (Request-ID: req-72625c39-334c-4863-aeee-74a2985f8e24) Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:40.980037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 12:04:40.981264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7311bbcd-41c6-48bf-ab0d-17e014e9440c could not be found. Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 28 12:04:40.982343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7311bbcd-41c6-48bf-ab0d-17e014e9440c could not be found. Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7311bbcd-41c6-48bf-ab0d-17e014e9440c could not be found. Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:40.983333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-46c9a82d-b0b6-42f1-9b85-6ba38b2ee3b9 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Returning 404 to user: Snapshot 7311bbcd-41c6-48bf-ab0d-17e014e9440c could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:04:40.984014 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-46c9a82d-b0b6-42f1-9b85-6ba38b2ee3b9 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c" status: 404 len: 111 microversion: 2.1 time: 0.083392 Jun 28 12:04:40.985957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 20/32] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:04:40 2022] GET /compute/v2.1/os-snapshots/7311bbcd-41c6-48bf-ab0d-17e014e9440c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:04:40.992349 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-33c5222e-c04d-497a-8ccb-87de29ec3241 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] Calling method '.version_select at 0x7f39380c60d0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:41.251434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-33c5222e-c04d-497a-8ccb-87de29ec3241 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.262566 Jun 28 12:04:41.251434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 21/33] 10.222.0.55 () {58 vars in 1148 bytes} [Tue Jun 28 12:04:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:41.255907 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-611360b1-2f81-4ed5-a83b-d294643df5bd tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f3938151c10>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:41.481692 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:04:41.483766 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:04:41.484610 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:04:41.485298 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:04:41.486242 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:04:41.498196 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-611360b1-2f81-4ed5-a83b-d294643df5bd tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939" status: 202 len: 0 microversion: 2.1 time: 0.245963 Jun 28 12:04:41.499686 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 22/34] 10.222.0.55 () {58 vars in 1247 bytes} [Tue Jun 28 12:04:41 2022] DELETE /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:04:41.509601 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5041bc4a-9765-4e1f-b858-259013a86d92 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] Calling method '.version_select at 0x7f39380c6af0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:41.547332 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:41.550301 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:41.553922 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:41.558775 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:41.702181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Getting quotas for project c47f35f9ae5e4a55be23a84e3887b915. Resources: {'cores', 'ram', 'instances'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:04:41.719037 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Getting quotas for user 2a54e9db924c440da63c04052fe058e6 and project c47f35f9ae5e4a55be23a84e3887b915. Resources: {'cores', 'ram', 'instances'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:04:41.762085 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:04:41.780215 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:04:41.820012 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5041bc4a-9765-4e1f-b858-259013a86d92 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.318726 Jun 28 12:04:41.821170 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 23/35] 10.222.0.55 () {58 vars in 1133 bytes} [Tue Jun 28 12:04:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:41.826221 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-84660af9-cfd2-46aa-af05-7f06dbc6208f tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f39380c6e50>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:42.008035 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-84660af9-cfd2-46aa-af05-7f06dbc6208f tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] HTTP exception thrown: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-84660af9-cfd2-46aa-af05-7f06dbc6208f tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Request method failure captured: Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939 HTTP/1.1 Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5FgNSXLfiz-Ze0MoSiU2VsdVvUWgXUNFd_h1UGihlfJxqGLzfKsJ7un_XLyrRzAgRkcDBtcc0kwEFJuPy0LJ14kIQC3Ts0Sjc00CgMcMLPnXKBLXu6l7BWtztE3bEJ_jcsNtyItN1XoTLfk_rOc9rwP3VqjtOqIAvvzQxJJ385lQc Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 9093a24833e6400098728603fb9e8306 Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:04:42.010488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9093a24833e6400098728603fb9e8306"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9093a24833e6400098728603fb9e8306"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9093a24833e6400098728603fb9e8306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9093a24833e6400098728603fb9e8306"}]}] Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 9093a24833e6400098728603fb9e8306 Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesSnapshotsTestJSON-73310748-project Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 187b061de2574e6d9a42584042f2c71e Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesSnapshotsTestJSON-73310748-project Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '60ac236a-140f-495b-840a-ff2918717939'} Jun 28 12:04:42.011612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. (HTTP 404) (Request-ID: req-bd89242a-7fb0-414e-8fff-acb8145cef30) Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:42.012283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 12:04:42.013317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 12:04:42.014980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-84660af9-cfd2-46aa-af05-7f06dbc6208f tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Returning 404 to user: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-84660af9-cfd2-46aa-af05-7f06dbc6208f tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939" status: 404 len: 109 microversion: 2.1 time: 0.190605 Jun 28 12:04:42.017347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 24/36] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:04:41 2022] GET /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939 => generated 109 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:04:42.031942 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-02b223f8-43b7-446a-a7bd-5a020d2fd59d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.306771 Jun 28 12:04:42.034318 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 13/37] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:04:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 4311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:04:42.045915 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d50a480a-e477-4c32-b4f6-edf5ac60aee0 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] Calling method '.version_select at 0x7f3938a3faf0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:42.048496 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3df7edfd-00a7-4530-8868-e741c893675d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:42.049438 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3df7edfd-00a7-4530-8868-e741c893675d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:42.094864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3df7edfd-00a7-4530-8868-e741c893675d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:42.101576 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3df7edfd-00a7-4530-8868-e741c893675d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:42.102756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3df7edfd-00a7-4530-8868-e741c893675d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:42.111102 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3df7edfd-00a7-4530-8868-e741c893675d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:42.415241 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3df7edfd-00a7-4530-8868-e741c893675d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:42.423333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3df7edfd-00a7-4530-8868-e741c893675d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1272 microversion: 2.1 time: 0.407531 Jun 28 12:04:42.435627 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 25/38] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:42 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1272 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:42.464749 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ce72600d-1deb-4a36-9060-63afb5682b67 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f39380c68b0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:42.574960 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d50a480a-e477-4c32-b4f6-edf5ac60aee0 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.537852 Jun 28 12:04:42.577588 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 14/39] 10.222.0.55 () {58 vars in 1166 bytes} [Tue Jun 28 12:04:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:42.582950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e7f41ab-212b-4a86-8c12-cde48f2e36d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:42.584169 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e7f41ab-212b-4a86-8c12-cde48f2e36d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:42.760591 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-ce72600d-1deb-4a36-9060-63afb5682b67 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] HTTP exception thrown: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ce72600d-1deb-4a36-9060-63afb5682b67 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Request method failure captured: Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939 HTTP/1.1 Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5FgNSXLfiz-Ze0MoSiU2VsdVvUWgXUNFd_h1UGihlfJxqGLzfKsJ7un_XLyrRzAgRkcDBtcc0kwEFJuPy0LJ14kIQC3Ts0Sjc00CgMcMLPnXKBLXu6l7BWtztE3bEJ_jcsNtyItN1XoTLfk_rOc9rwP3VqjtOqIAvvzQxJJ385lQc Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 9093a24833e6400098728603fb9e8306 Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:04:42.763407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9093a24833e6400098728603fb9e8306"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9093a24833e6400098728603fb9e8306"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9093a24833e6400098728603fb9e8306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9093a24833e6400098728603fb9e8306"}]}] Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 9093a24833e6400098728603fb9e8306 Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesSnapshotsTestJSON-73310748-project Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 187b061de2574e6d9a42584042f2c71e Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesSnapshotsTestJSON-73310748-project Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '60ac236a-140f-495b-840a-ff2918717939'} Jun 28 12:04:42.764529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. (HTTP 404) (Request-ID: req-9d13108f-cf4e-4c4b-833d-256fa50383c8) Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:42.765621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 12:04:42.766944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 28 12:04:42.772810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ce72600d-1deb-4a36-9060-63afb5682b67 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Returning 404 to user: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ce72600d-1deb-4a36-9060-63afb5682b67 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939" status: 404 len: 109 microversion: 2.1 time: 0.330523 Jun 28 12:04:42.777545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 26/40] 10.222.0.55 () {58 vars in 1247 bytes} [Tue Jun 28 12:04:42 2022] DELETE /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939 => generated 109 bytes in 332 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:04:42.779293 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a8078a55-5bb0-443a-bd52-4eb60ba2c20f tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] Calling method '.version_select at 0x7f3938072790>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:42.857886 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e7f41ab-212b-4a86-8c12-cde48f2e36d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:42.868283 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e7f41ab-212b-4a86-8c12-cde48f2e36d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1221 microversion: 2.1 time: 0.288918 Jun 28 12:04:42.869765 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 15/41] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:42 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1221 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:42.884022 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1086688572", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e8609e8-a972-43b0-88c4-e5c50e709831"}], "security_groups": [{"name": "tempest-securitygroup--438979531"}], "key_name": "tempest-keypair-1349213626", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:43.143095 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a8078a55-5bb0-443a-bd52-4eb60ba2c20f tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.372704 Jun 28 12:04:43.143676 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 27/42] 10.222.0.55 () {58 vars in 1169 bytes} [Tue Jun 28 12:04:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:43.151129 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2c289e72-0d1b-4da7-b9d9-63d714036c42 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Calling method '.version_select at 0x7f39380c6160>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:43.227686 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-2c289e72-0d1b-4da7-b9d9-63d714036c42 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] HTTP exception thrown: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2c289e72-0d1b-4da7-b9d9-63d714036c42 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Request method failure captured: Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939 HTTP/1.1 Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5FgNSXLfiz-Ze0MoSiU2VsdVvUWgXUNFd_h1UGihlfJxqGLzfKsJ7un_XLyrRzAgRkcDBtcc0kwEFJuPy0LJ14kIQC3Ts0Sjc00CgMcMLPnXKBLXu6l7BWtztE3bEJ_jcsNtyItN1XoTLfk_rOc9rwP3VqjtOqIAvvzQxJJ385lQc Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 9093a24833e6400098728603fb9e8306 Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:04:43.230854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9093a24833e6400098728603fb9e8306"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9093a24833e6400098728603fb9e8306"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9093a24833e6400098728603fb9e8306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9093a24833e6400098728603fb9e8306"}]}] Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 9093a24833e6400098728603fb9e8306 Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-73310748 Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesSnapshotsTestJSON-73310748-project Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 187b061de2574e6d9a42584042f2c71e Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesSnapshotsTestJSON-73310748-project Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '60ac236a-140f-495b-840a-ff2918717939'} Jun 28 12:04:43.232569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. (HTTP 404) (Request-ID: req-fc9c482f-688b-4fa6-92d2-211caaedbb5d) Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:43.233281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 12:04:43.234265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 12:04:43.235288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:04:43.236212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:43.236212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:43.236212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:04:43.236212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:43.236212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:04:43.236212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:04:43.236212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:04:43.236212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:04:43.236212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:04:43.236212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. Jun 28 12:04:43.236212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:04:43.238590 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2c289e72-0d1b-4da7-b9d9-63d714036c42 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] Returning 404 to user: Volume 60ac236a-140f-495b-840a-ff2918717939 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:04:43.239717 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2c289e72-0d1b-4da7-b9d9-63d714036c42 tempest-VolumesSnapshotsTestJSON-73310748 tempest-VolumesSnapshotsTestJSON-73310748-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939" status: 404 len: 109 microversion: 2.1 time: 0.094540 Jun 28 12:04:43.242627 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 28/43] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:04:43 2022] GET /compute/v2.1/os-volumes/60ac236a-140f-495b-840a-ff2918717939 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:04:43.291480 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-263356372", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:43.469387 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] validate_networks() for [('53ee723f-205c-4be8-bee6-2b68e9be82de', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:04:43.748717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] validate_networks() for [('4e8609e8-a972-43b0-88c4-e5c50e709831', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:04:44.116627 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:45.146767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:04:45.147510 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:04:45.148480 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:04:45.148926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:04:45.149455 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:04:45.230584 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:45.234673 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:45.239805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:45.241684 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:45.318172 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Getting quotas for project c47f35f9ae5e4a55be23a84e3887b915. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:04:45.323367 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Getting quotas for user 2a54e9db924c440da63c04052fe058e6 and project c47f35f9ae5e4a55be23a84e3887b915. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:04:45.372301 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:04:45.384492 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:04:45.612197 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7f8a4571-eb5d-4cda-afdf-05f3d8f239d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.366141 Jun 28 12:04:45.619660 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 29/44] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:04:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:04:45.626866 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9e84eb84-6a4b-46fa-afc0-dd304dcfafcc tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] Calling method '.version_select at 0x7f39380c6ee0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:46.054444 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9e84eb84-6a4b-46fa-afc0-dd304dcfafcc tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.433215 Jun 28 12:04:46.055174 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 30/45] 10.222.0.55 () {58 vars in 1154 bytes} [Tue Jun 28 12:04:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:46.059993 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b467ae9a-9c78-4813-8f44-f63482f51ae0 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:46.060768 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b467ae9a-9c78-4813-8f44-f63482f51ae0 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:46.079070 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b467ae9a-9c78-4813-8f44-f63482f51ae0 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:46.079878 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b467ae9a-9c78-4813-8f44-f63482f51ae0 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:46.082973 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b467ae9a-9c78-4813-8f44-f63482f51ae0 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:46.083847 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b467ae9a-9c78-4813-8f44-f63482f51ae0 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:46.688697 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b467ae9a-9c78-4813-8f44-f63482f51ae0 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:46.702339 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b467ae9a-9c78-4813-8f44-f63482f51ae0 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.645931 Jun 28 12:04:46.703817 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 31/46] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:46 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:46.714110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-baf4e2c7-56ab-46fc-9932-792c0f414d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:46.716587 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-baf4e2c7-56ab-46fc-9932-792c0f414d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:46.894875 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-baf4e2c7-56ab-46fc-9932-792c0f414d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:46.904862 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-baf4e2c7-56ab-46fc-9932-792c0f414d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1221 microversion: 2.1 time: 0.197377 Jun 28 12:04:46.905672 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 32/47] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:46 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1221 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:46.924771 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5983ec7e-2cc8-4c86-af59-3d51876d866b tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] Calling method '.version_select at 0x7f39380c68b0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:47.357823 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5983ec7e-2cc8-4c86-af59-3d51876d866b tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.448218 Jun 28 12:04:47.358397 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 33/48] 10.222.0.55 () {58 vars in 1187 bytes} [Tue Jun 28 12:04:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:47.372946 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8adfcada-4428-4b5d-b521-667d88410f37 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] Calling method '.version_select at 0x7f3938072b80>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:47.692007 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8adfcada-4428-4b5d-b521-667d88410f37 tempest-VolumesTestJSON-608145097 tempest-VolumesTestJSON-608145097-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.324654 Jun 28 12:04:47.692662 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 34/49] 10.222.0.55 () {58 vars in 1154 bytes} [Tue Jun 28 12:04:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:47.722681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-34702cef-b900-4a8a-af13-b9e2ef8f3232 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:47.723517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-34702cef-b900-4a8a-af13-b9e2ef8f3232 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:47.749935 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34702cef-b900-4a8a-af13-b9e2ef8f3232 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:47.752223 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34702cef-b900-4a8a-af13-b9e2ef8f3232 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:47.761449 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34702cef-b900-4a8a-af13-b9e2ef8f3232 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:47.762303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34702cef-b900-4a8a-af13-b9e2ef8f3232 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:48.619965 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:04:48.620741 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:04:48.621591 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:04:48.622009 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:04:48.622735 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:04:48.669537 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:48.670022 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:48.678221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:48.684034 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:48.746703 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-34702cef-b900-4a8a-af13-b9e2ef8f3232 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:48.760019 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-34702cef-b900-4a8a-af13-b9e2ef8f3232 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 1.043835 Jun 28 12:04:48.765015 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 35/50] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:47 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:48.783488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-424514b2-190b-41e2-b129-96733a0c122b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:48.791823 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-424514b2-190b-41e2-b129-96733a0c122b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:48.807191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-424514b2-190b-41e2-b129-96733a0c122b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:48.807652 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-424514b2-190b-41e2-b129-96733a0c122b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:48.808425 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-424514b2-190b-41e2-b129-96733a0c122b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:48.808867 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-424514b2-190b-41e2-b129-96733a0c122b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:48.824866 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Getting quotas for project cb27799cde2e4258a2eedc5bda555c61. Resources: {'cores', 'ram', 'instances'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:04:48.847686 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Getting quotas for user 702dcd49668c4680b5bf3c1c75575ab7 and project cb27799cde2e4258a2eedc5bda555c61. Resources: {'cores', 'ram', 'instances'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:04:48.937986 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:04:48.970569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:04:49.166911 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3ff91617-878d-488f-a26c-561d4aa00039 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 6.292962 Jun 28 12:04:49.167923 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 16/51] 10.222.0.55 () {62 vars in 1187 bytes} [Tue Jun 28 12:04:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 6297 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 28 12:04:49.179060 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d60c9f55-6934-4302-a326-af363970e6fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:49.179736 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d60c9f55-6934-4302-a326-af363970e6fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:50.315443 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-424514b2-190b-41e2-b129-96733a0c122b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:50.323491 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-424514b2-190b-41e2-b129-96733a0c122b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1279 microversion: 2.1 time: 1.555911 Jun 28 12:04:50.324606 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 36/52] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:48 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1279 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:50.329552 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5b79aa81-9005-4afa-9a4b-59e62db71303 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:50.330347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5b79aa81-9005-4afa-9a4b-59e62db71303 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:50.337416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b79aa81-9005-4afa-9a4b-59e62db71303 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:50.338116 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b79aa81-9005-4afa-9a4b-59e62db71303 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:50.339053 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b79aa81-9005-4afa-9a4b-59e62db71303 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:50.339642 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b79aa81-9005-4afa-9a4b-59e62db71303 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:50.429256 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d60c9f55-6934-4302-a326-af363970e6fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:50.446227 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d60c9f55-6934-4302-a326-af363970e6fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:50.451981 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d60c9f55-6934-4302-a326-af363970e6fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:50.454388 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d60c9f55-6934-4302-a326-af363970e6fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1282 microversion: 2.20 time: 1.279797 Jun 28 12:04:50.456439 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 17/53] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:04:49 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1282 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:04:51.341629 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-243d0dbe-9d93-486f-b3cc-0c4781656223 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:51.342995 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-243d0dbe-9d93-486f-b3cc-0c4781656223 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:51.378150 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-243d0dbe-9d93-486f-b3cc-0c4781656223 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:51.388525 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-243d0dbe-9d93-486f-b3cc-0c4781656223 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:51.390282 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-243d0dbe-9d93-486f-b3cc-0c4781656223 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:51.396015 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-243d0dbe-9d93-486f-b3cc-0c4781656223 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:51.859145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-243d0dbe-9d93-486f-b3cc-0c4781656223 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:51.898499 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-243d0dbe-9d93-486f-b3cc-0c4781656223 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1279 microversion: 2.1 time: 0.560355 Jun 28 12:04:51.898759 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 18/54] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:51 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1279 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:04:51.951976 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d2f517d8-ac60-42e6-b490-9fa0f3639b2b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:51.958645 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d2f517d8-ac60-42e6-b490-9fa0f3639b2b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:52.007644 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5b79aa81-9005-4afa-9a4b-59e62db71303 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:52.009035 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2f517d8-ac60-42e6-b490-9fa0f3639b2b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:52.013160 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2f517d8-ac60-42e6-b490-9fa0f3639b2b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:52.014086 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2f517d8-ac60-42e6-b490-9fa0f3639b2b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:52.019818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5b79aa81-9005-4afa-9a4b-59e62db71303 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 1.689837 Jun 28 12:04:52.020466 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 37/55] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:50 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:52.032098 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2f517d8-ac60-42e6-b490-9fa0f3639b2b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:52.059718 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-225670181", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e8b44d5-6b8c-4229-8616-a6790fa7caa6"}], "security_groups": [{"name": "tempest-securitygroup--1695828376"}], "key_name": "tempest-keypair-870893037", "user_data": "}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:52.126839 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=8 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:52.383642 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2f517d8-ac60-42e6-b490-9fa0f3639b2b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:52.404743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2f517d8-ac60-42e6-b490-9fa0f3639b2b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:52.413209 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2f517d8-ac60-42e6-b490-9fa0f3639b2b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:52.419890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d2f517d8-ac60-42e6-b490-9fa0f3639b2b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1342 microversion: 2.20 time: 0.487152 Jun 28 12:04:52.421506 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 19/56] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:04:51 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1342 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:04:53.409818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] validate_networks() for [('5e8b44d5-6b8c-4229-8616-a6790fa7caa6', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:04:53.596949 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-90c2f6a1-d461-4868-a773-9e5b05c899ce req-0f2403a7-af49-45e4-9078-c544fb41a27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fea86db2-6a76-4e24-b41c-ab22b7f1d759", "tag": "63424f2c-afc9-4ae8-835f-0daf13f6f344"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:53.659909 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-90c2f6a1-d461-4868-a773-9e5b05c899ce req-0f2403a7-af49-45e4-9078-c544fb41a27e service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:53.660395 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-90c2f6a1-d461-4868-a773-9e5b05c899ce req-0f2403a7-af49-45e4-9078-c544fb41a27e service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:53.736269 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-90c2f6a1-d461-4868-a773-9e5b05c899ce req-0f2403a7-af49-45e4-9078-c544fb41a27e service nova] Creating event network-changed:63424f2c-afc9-4ae8-835f-0daf13f6f344 for instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 on hv-cinder-84795 Jun 28 12:04:53.737610 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-90c2f6a1-d461-4868-a773-9e5b05c899ce req-0f2403a7-af49-45e4-9078-c544fb41a27e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117889) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 28 12:04:53.739927 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29d3014d-0480-457a-952a-c8070114cbe8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:53.741460 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29d3014d-0480-457a-952a-c8070114cbe8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:53.763732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29d3014d-0480-457a-952a-c8070114cbe8 None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:53.765330 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29d3014d-0480-457a-952a-c8070114cbe8 None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:53.781200 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.compute.rpcapi [None req-29d3014d-0480-457a-952a-c8070114cbe8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 28 12:04:53.782206 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29d3014d-0480-457a-952a-c8070114cbe8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117889) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 28 12:04:53.808385 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-29d3014d-0480-457a-952a-c8070114cbe8 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.384180 Jun 28 12:04:53.811119 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 20/57] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:53.826471 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5d0c6676-91d1-4a7b-9b3e-0c3c5cc5e5e5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:53.828521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5d0c6676-91d1-4a7b-9b3e-0c3c5cc5e5e5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:53.845356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d0c6676-91d1-4a7b-9b3e-0c3c5cc5e5e5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:53.846735 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d0c6676-91d1-4a7b-9b3e-0c3c5cc5e5e5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:53.847839 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d0c6676-91d1-4a7b-9b3e-0c3c5cc5e5e5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:53.851056 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d0c6676-91d1-4a7b-9b3e-0c3c5cc5e5e5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:54.645750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d0c6676-91d1-4a7b-9b3e-0c3c5cc5e5e5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:54.654477 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5d0c6676-91d1-4a7b-9b3e-0c3c5cc5e5e5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1279 microversion: 2.1 time: 0.837920 Jun 28 12:04:54.664001 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 21/58] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:53 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1279 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:54.671618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a0ed0eeb-c1fa-499c-8988-f21c3a5359b6 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:54.672245 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a0ed0eeb-c1fa-499c-8988-f21c3a5359b6 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:54.695540 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0ed0eeb-c1fa-499c-8988-f21c3a5359b6 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:54.695998 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0ed0eeb-c1fa-499c-8988-f21c3a5359b6 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:54.706343 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0ed0eeb-c1fa-499c-8988-f21c3a5359b6 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:54.706896 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0ed0eeb-c1fa-499c-8988-f21c3a5359b6 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:55.274421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:56.421083 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a0ed0eeb-c1fa-499c-8988-f21c3a5359b6 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:56.441616 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a0ed0eeb-c1fa-499c-8988-f21c3a5359b6 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 1.781536 Jun 28 12:04:56.442750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 22/59] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:54 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:56.448536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3d8112e2-b260-45e9-9b5f-5ceae080d290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:56.454299 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3d8112e2-b260-45e9-9b5f-5ceae080d290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:56.456917 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:04:56.478278 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d8112e2-b260-45e9-9b5f-5ceae080d290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:56.483964 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d8112e2-b260-45e9-9b5f-5ceae080d290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:56.485118 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d8112e2-b260-45e9-9b5f-5ceae080d290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:56.485893 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d8112e2-b260-45e9-9b5f-5ceae080d290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:56.533503 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:04:56.535103 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:04:56.536610 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:04:56.537467 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:04:56.538706 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:04:56.579498 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:56.580192 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:56.585700 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:56.586357 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:56.629614 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Getting quotas for project 73679a9c1e1140dab3237b74ff50d3c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:04:56.644466 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3d8112e2-b260-45e9-9b5f-5ceae080d290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:56.661612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Getting quotas for user b8d8d0c23f744a7b9ad311581f6ae39f and project 73679a9c1e1140dab3237b74ff50d3c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:04:56.682215 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3d8112e2-b260-45e9-9b5f-5ceae080d290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:56.684325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3d8112e2-b260-45e9-9b5f-5ceae080d290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:56.692178 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3d8112e2-b260-45e9-9b5f-5ceae080d290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1340 microversion: 2.20 time: 0.248024 Jun 28 12:04:56.692764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 23/60] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:04:56 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1340 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:04:56.693157 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:04:56.695879 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:04:56.721798 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2121a294-6945-49df-8b8c-0da293836147 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:56.722430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2121a294-6945-49df-8b8c-0da293836147 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:56.740536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2121a294-6945-49df-8b8c-0da293836147 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:56.753276 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2121a294-6945-49df-8b8c-0da293836147 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:56.754508 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2121a294-6945-49df-8b8c-0da293836147 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:56.754966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2121a294-6945-49df-8b8c-0da293836147 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:56.851364 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e2367471-9d50-4882-b5cc-68858c63399d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.829741 Jun 28 12:04:56.852641 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 38/61] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:04:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 4831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:04:56.965609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-31380dd4-b1b1-40e6-acfe-9aa1ed02cc2e req-74a6a2b5-d46e-463a-acef-a320397a03e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46baa815-7582-46ae-a0ea-3d29be972512", "tag": "5b57bf11-d959-4b21-a64c-807b0e2c9f63"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:56.991417 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-31380dd4-b1b1-40e6-acfe-9aa1ed02cc2e req-74a6a2b5-d46e-463a-acef-a320397a03e7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:56.993077 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-31380dd4-b1b1-40e6-acfe-9aa1ed02cc2e req-74a6a2b5-d46e-463a-acef-a320397a03e7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:57.048236 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-31380dd4-b1b1-40e6-acfe-9aa1ed02cc2e req-74a6a2b5-d46e-463a-acef-a320397a03e7 service nova] Creating event network-changed:5b57bf11-d959-4b21-a64c-807b0e2c9f63 for instance 46baa815-7582-46ae-a0ea-3d29be972512 on hv-cinder-84795 Jun 28 12:04:57.049741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-31380dd4-b1b1-40e6-acfe-9aa1ed02cc2e req-74a6a2b5-d46e-463a-acef-a320397a03e7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117888) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 28 12:04:57.051339 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-214912cb-445e-4066-8800-2a7116dd9f61 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:57.051989 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-214912cb-445e-4066-8800-2a7116dd9f61 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:57.053216 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-214912cb-445e-4066-8800-2a7116dd9f61 None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:57.056006 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-214912cb-445e-4066-8800-2a7116dd9f61 None None] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:57.072248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.compute.rpcapi [None req-214912cb-445e-4066-8800-2a7116dd9f61 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 28 12:04:57.074940 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-214912cb-445e-4066-8800-2a7116dd9f61 None None] Releasing lock "compute-rpcapi-router" {{(pid=117888) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 28 12:04:57.113056 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-214912cb-445e-4066-8800-2a7116dd9f61 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258884 Jun 28 12:04:57.113937 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 39/62] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:04:57.128580 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2121a294-6945-49df-8b8c-0da293836147 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:57.139918 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2121a294-6945-49df-8b8c-0da293836147 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.436550 Jun 28 12:04:57.144261 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 24/63] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:56 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:57.150911 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c4fa89a6-3409-47ae-a588-8a1d568a4c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:57.153659 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c4fa89a6-3409-47ae-a588-8a1d568a4c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:57.270547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c4fa89a6-3409-47ae-a588-8a1d568a4c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:57.282287 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c4fa89a6-3409-47ae-a588-8a1d568a4c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1236 microversion: 2.1 time: 0.166625 Jun 28 12:04:57.282872 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 40/64] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:57 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1236 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:57.472125 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c10c0c3c-d392-44c2-8727-0a4ff194721d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:57.473340 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c10c0c3c-d392-44c2-8727-0a4ff194721d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:57.484802 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c10c0c3c-d392-44c2-8727-0a4ff194721d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:57.485465 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c10c0c3c-d392-44c2-8727-0a4ff194721d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:57.486447 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c10c0c3c-d392-44c2-8727-0a4ff194721d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:57.487064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c10c0c3c-d392-44c2-8727-0a4ff194721d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:57.592130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-e512a442-9abc-42f3-93a9-7eead2f66a15 req-c65791b0-6951-4ada-9602-42722818d1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8e28f3-fac6-4e0d-87c5-2480dd846898", "tag": "689820bb-e174-4537-8fa7-10a586085c72"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:04:57.614869 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-e512a442-9abc-42f3-93a9-7eead2f66a15 req-c65791b0-6951-4ada-9602-42722818d1d4 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:57.615666 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-e512a442-9abc-42f3-93a9-7eead2f66a15 req-c65791b0-6951-4ada-9602-42722818d1d4 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:57.639637 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-e512a442-9abc-42f3-93a9-7eead2f66a15 req-c65791b0-6951-4ada-9602-42722818d1d4 service nova] Creating event network-changed:689820bb-e174-4537-8fa7-10a586085c72 for instance 0e8e28f3-fac6-4e0d-87c5-2480dd846898 on hv-cinder-84795 Jun 28 12:04:57.645238 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-e512a442-9abc-42f3-93a9-7eead2f66a15 req-c65791b0-6951-4ada-9602-42722818d1d4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063229 Jun 28 12:04:57.645904 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 41/65] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:04:57.712015 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-acfa51e7-8373-48c5-8ba6-6e2b4e436b2e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:57.713283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-acfa51e7-8373-48c5-8ba6-6e2b4e436b2e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:57.722671 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-acfa51e7-8373-48c5-8ba6-6e2b4e436b2e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:57.723478 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-acfa51e7-8373-48c5-8ba6-6e2b4e436b2e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:57.724362 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-acfa51e7-8373-48c5-8ba6-6e2b4e436b2e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:57.724940 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-acfa51e7-8373-48c5-8ba6-6e2b4e436b2e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:57.756543 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c10c0c3c-d392-44c2-8727-0a4ff194721d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:57.773538 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c10c0c3c-d392-44c2-8727-0a4ff194721d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.301777 Jun 28 12:04:57.773538 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 25/66] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:57 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:57.962729 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-acfa51e7-8373-48c5-8ba6-6e2b4e436b2e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:57.975096 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-acfa51e7-8373-48c5-8ba6-6e2b4e436b2e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:57.977748 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-acfa51e7-8373-48c5-8ba6-6e2b4e436b2e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:57.980305 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-acfa51e7-8373-48c5-8ba6-6e2b4e436b2e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.273353 Jun 28 12:04:57.987472 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 42/67] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:04:57 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:04:58.161573 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ed6071cd-f325-44e2-a8ce-cc96400276ca tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:58.162330 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ed6071cd-f325-44e2-a8ce-cc96400276ca tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:58.168881 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed6071cd-f325-44e2-a8ce-cc96400276ca tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:58.169371 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed6071cd-f325-44e2-a8ce-cc96400276ca tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:58.170146 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed6071cd-f325-44e2-a8ce-cc96400276ca tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:58.170650 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed6071cd-f325-44e2-a8ce-cc96400276ca tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:58.301511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-95b9c65d-0c80-404c-951d-636886eab733 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:58.302511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-95b9c65d-0c80-404c-951d-636886eab733 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:58.309469 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-95b9c65d-0c80-404c-951d-636886eab733 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:58.310230 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-95b9c65d-0c80-404c-951d-636886eab733 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:58.311326 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-95b9c65d-0c80-404c-951d-636886eab733 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:58.312061 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-95b9c65d-0c80-404c-951d-636886eab733 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:58.323960 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ed6071cd-f325-44e2-a8ce-cc96400276ca tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:58.335613 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ed6071cd-f325-44e2-a8ce-cc96400276ca tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.177711 Jun 28 12:04:58.346891 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 26/68] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:58 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:04:58.380158 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-95b9c65d-0c80-404c-951d-636886eab733 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:58.389949 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-95b9c65d-0c80-404c-951d-636886eab733 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1240 microversion: 2.1 time: 0.092604 Jun 28 12:04:58.393017 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 43/69] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:58 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:58.790395 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5543521c-64b8-4876-a381-971c1076cb82 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:58.791028 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5543521c-64b8-4876-a381-971c1076cb82 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:58.797485 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5543521c-64b8-4876-a381-971c1076cb82 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:58.798011 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5543521c-64b8-4876-a381-971c1076cb82 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:58.798954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5543521c-64b8-4876-a381-971c1076cb82 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:58.799575 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5543521c-64b8-4876-a381-971c1076cb82 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:58.934996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5543521c-64b8-4876-a381-971c1076cb82 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:58.942899 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5543521c-64b8-4876-a381-971c1076cb82 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.156558 Jun 28 12:04:58.952214 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 27/70] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:58 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:59.004776 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-41f82017-930b-40b2-acf7-5d719ecb6484 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:59.005616 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-41f82017-930b-40b2-acf7-5d719ecb6484 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:59.011911 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-41f82017-930b-40b2-acf7-5d719ecb6484 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:59.012377 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-41f82017-930b-40b2-acf7-5d719ecb6484 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:59.013177 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-41f82017-930b-40b2-acf7-5d719ecb6484 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:59.013637 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-41f82017-930b-40b2-acf7-5d719ecb6484 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:59.183314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-41f82017-930b-40b2-acf7-5d719ecb6484 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:59.191664 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-41f82017-930b-40b2-acf7-5d719ecb6484 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:59.194696 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-41f82017-930b-40b2-acf7-5d719ecb6484 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:59.195830 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-41f82017-930b-40b2-acf7-5d719ecb6484 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.195281 Jun 28 12:04:59.196392 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 44/71] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:04:58 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:04:59.355026 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e4721e18-79b7-44b4-b64b-cd4148069a50 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:59.355765 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e4721e18-79b7-44b4-b64b-cd4148069a50 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:59.361829 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e4721e18-79b7-44b4-b64b-cd4148069a50 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:59.362743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e4721e18-79b7-44b4-b64b-cd4148069a50 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:59.364947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e4721e18-79b7-44b4-b64b-cd4148069a50 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:59.365555 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e4721e18-79b7-44b4-b64b-cd4148069a50 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:59.408368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f26d3f75-4759-455c-889b-239e4a53c534 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:59.409457 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f26d3f75-4759-455c-889b-239e4a53c534 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:59.416259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f26d3f75-4759-455c-889b-239e4a53c534 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:59.416700 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f26d3f75-4759-455c-889b-239e4a53c534 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:59.417618 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f26d3f75-4759-455c-889b-239e4a53c534 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:59.418205 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f26d3f75-4759-455c-889b-239e4a53c534 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:59.510638 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f26d3f75-4759-455c-889b-239e4a53c534 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:59.521296 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f26d3f75-4759-455c-889b-239e4a53c534 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1240 microversion: 2.1 time: 0.117981 Jun 28 12:04:59.523058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 45/72] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:59 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1240 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:04:59.584311 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e4721e18-79b7-44b4-b64b-cd4148069a50 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:04:59.591749 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e4721e18-79b7-44b4-b64b-cd4148069a50 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.242483 Jun 28 12:04:59.593707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 28/73] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:59 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:04:59.960131 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d89b050b-6331-4db1-b1c3-a06f8b6f6daa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:04:59.960893 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d89b050b-6331-4db1-b1c3-a06f8b6f6daa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:04:59.971050 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d89b050b-6331-4db1-b1c3-a06f8b6f6daa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:59.971798 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d89b050b-6331-4db1-b1c3-a06f8b6f6daa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:04:59.972667 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d89b050b-6331-4db1-b1c3-a06f8b6f6daa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:04:59.973226 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d89b050b-6331-4db1-b1c3-a06f8b6f6daa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:00.170806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d89b050b-6331-4db1-b1c3-a06f8b6f6daa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:00.180484 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d89b050b-6331-4db1-b1c3-a06f8b6f6daa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.224653 Jun 28 12:05:00.181229 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 46/74] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:04:59 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:00.216779 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bf565a8a-50db-49f7-ba02-f59caa1730ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:00.218387 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bf565a8a-50db-49f7-ba02-f59caa1730ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:00.226286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf565a8a-50db-49f7-ba02-f59caa1730ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:00.226748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf565a8a-50db-49f7-ba02-f59caa1730ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:00.227788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf565a8a-50db-49f7-ba02-f59caa1730ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:00.227992 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf565a8a-50db-49f7-ba02-f59caa1730ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:00.388303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf565a8a-50db-49f7-ba02-f59caa1730ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:00.404035 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf565a8a-50db-49f7-ba02-f59caa1730ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:00.405624 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf565a8a-50db-49f7-ba02-f59caa1730ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:00.410196 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bf565a8a-50db-49f7-ba02-f59caa1730ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.197709 Jun 28 12:05:00.410564 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 29/75] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:00 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:00.539051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-90cae030-4eec-447a-9e29-4777f3d52e34 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:00.539662 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-90cae030-4eec-447a-9e29-4777f3d52e34 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:00.545789 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90cae030-4eec-447a-9e29-4777f3d52e34 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:00.546414 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90cae030-4eec-447a-9e29-4777f3d52e34 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:00.547240 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90cae030-4eec-447a-9e29-4777f3d52e34 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:00.547736 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90cae030-4eec-447a-9e29-4777f3d52e34 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:00.609961 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-de8553ee-d5eb-4ddc-9752-070237b5b42e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:00.610569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-de8553ee-d5eb-4ddc-9752-070237b5b42e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:00.612476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=18 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:00.622338 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de8553ee-d5eb-4ddc-9752-070237b5b42e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:00.623075 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de8553ee-d5eb-4ddc-9752-070237b5b42e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:00.624427 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de8553ee-d5eb-4ddc-9752-070237b5b42e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:00.625125 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de8553ee-d5eb-4ddc-9752-070237b5b42e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:00.627699 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-90cae030-4eec-447a-9e29-4777f3d52e34 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:00.636414 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-90cae030-4eec-447a-9e29-4777f3d52e34 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1240 microversion: 2.1 time: 0.101037 Jun 28 12:05:00.637111 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 47/76] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:00 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:00.876839 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-de8553ee-d5eb-4ddc-9752-070237b5b42e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:00.893365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-de8553ee-d5eb-4ddc-9752-070237b5b42e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.287810 Jun 28 12:05:00.903986 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 30/77] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:00 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:01.199054 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a9b53b68-8965-4d99-a8cf-1aa825407123 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:01.200172 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a9b53b68-8965-4d99-a8cf-1aa825407123 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:01.207110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9b53b68-8965-4d99-a8cf-1aa825407123 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:01.207646 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9b53b68-8965-4d99-a8cf-1aa825407123 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:01.208492 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9b53b68-8965-4d99-a8cf-1aa825407123 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:01.209015 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9b53b68-8965-4d99-a8cf-1aa825407123 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:01.229411 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:01.388570 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a9b53b68-8965-4d99-a8cf-1aa825407123 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:01.397286 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a9b53b68-8965-4d99-a8cf-1aa825407123 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.202959 Jun 28 12:05:01.397884 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 48/78] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:01 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:01.435769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c6ad8d98-644e-411a-8ccd-137bbd37a8fb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:01.436515 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c6ad8d98-644e-411a-8ccd-137bbd37a8fb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:01.445125 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6ad8d98-644e-411a-8ccd-137bbd37a8fb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:01.445586 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6ad8d98-644e-411a-8ccd-137bbd37a8fb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:01.446415 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6ad8d98-644e-411a-8ccd-137bbd37a8fb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:01.448602 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6ad8d98-644e-411a-8ccd-137bbd37a8fb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:01.604311 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c6ad8d98-644e-411a-8ccd-137bbd37a8fb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:01.616803 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c6ad8d98-644e-411a-8ccd-137bbd37a8fb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:01.619341 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c6ad8d98-644e-411a-8ccd-137bbd37a8fb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:01.622043 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c6ad8d98-644e-411a-8ccd-137bbd37a8fb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.197320 Jun 28 12:05:01.623099 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 31/79] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:01 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:01.653018 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6b550fb8-7c66-474b-8565-5b76222499fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:01.653632 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6b550fb8-7c66-474b-8565-5b76222499fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:01.660585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b550fb8-7c66-474b-8565-5b76222499fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:01.661515 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b550fb8-7c66-474b-8565-5b76222499fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:01.662601 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b550fb8-7c66-474b-8565-5b76222499fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:01.664462 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6b550fb8-7c66-474b-8565-5b76222499fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:01.746197 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6b550fb8-7c66-474b-8565-5b76222499fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:01.754552 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6b550fb8-7c66-474b-8565-5b76222499fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1240 microversion: 2.1 time: 0.105422 Jun 28 12:05:01.755135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 49/80] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:01 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:01.910665 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c4b76ee6-b0da-47c5-975c-21028c06b64b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:01.911286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c4b76ee6-b0da-47c5-975c-21028c06b64b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:01.917560 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4b76ee6-b0da-47c5-975c-21028c06b64b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:01.918208 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4b76ee6-b0da-47c5-975c-21028c06b64b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:01.918981 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4b76ee6-b0da-47c5-975c-21028c06b64b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:01.919412 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4b76ee6-b0da-47c5-975c-21028c06b64b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:02.070435 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4b76ee6-b0da-47c5-975c-21028c06b64b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:02.087284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c4b76ee6-b0da-47c5-975c-21028c06b64b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.176051 Jun 28 12:05:02.089101 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 32/81] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:01 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:02.415518 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0d4acd71-7ca0-4881-ab13-1650c21b257f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:02.416607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0d4acd71-7ca0-4881-ab13-1650c21b257f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:02.422921 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d4acd71-7ca0-4881-ab13-1650c21b257f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:02.423531 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d4acd71-7ca0-4881-ab13-1650c21b257f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:02.424488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d4acd71-7ca0-4881-ab13-1650c21b257f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:02.425090 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d4acd71-7ca0-4881-ab13-1650c21b257f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:02.579023 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0d4acd71-7ca0-4881-ab13-1650c21b257f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:02.586560 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0d4acd71-7ca0-4881-ab13-1650c21b257f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.175751 Jun 28 12:05:02.587068 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 50/82] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:02 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:02.640096 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-74f3d311-4578-42ca-bc08-5c3a5e558a85 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:02.640711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-74f3d311-4578-42ca-bc08-5c3a5e558a85 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:02.647589 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74f3d311-4578-42ca-bc08-5c3a5e558a85 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:02.648041 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74f3d311-4578-42ca-bc08-5c3a5e558a85 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:02.648806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74f3d311-4578-42ca-bc08-5c3a5e558a85 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:02.649260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74f3d311-4578-42ca-bc08-5c3a5e558a85 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:02.776116 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e9e5dd79-e819-479a-a08c-fa6d807925a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:02.777188 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e9e5dd79-e819-479a-a08c-fa6d807925a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:02.785677 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e9e5dd79-e819-479a-a08c-fa6d807925a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:02.786122 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e9e5dd79-e819-479a-a08c-fa6d807925a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:02.786963 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e9e5dd79-e819-479a-a08c-fa6d807925a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:02.787457 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e9e5dd79-e819-479a-a08c-fa6d807925a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:02.803878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-74f3d311-4578-42ca-bc08-5c3a5e558a85 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:02.812328 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-74f3d311-4578-42ca-bc08-5c3a5e558a85 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:02.813926 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-74f3d311-4578-42ca-bc08-5c3a5e558a85 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:02.815043 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-74f3d311-4578-42ca-bc08-5c3a5e558a85 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.179277 Jun 28 12:05:02.815921 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 33/83] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:02 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:05:02.875897 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e9e5dd79-e819-479a-a08c-fa6d807925a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:02.884191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e9e5dd79-e819-479a-a08c-fa6d807925a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1240 microversion: 2.1 time: 0.116583 Jun 28 12:05:02.887760 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 51/84] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:02 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:03.107147 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9c3cc23c-327a-459b-aeb6-eb7027de1049 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:03.108219 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9c3cc23c-327a-459b-aeb6-eb7027de1049 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:03.120334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c3cc23c-327a-459b-aeb6-eb7027de1049 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:03.120334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c3cc23c-327a-459b-aeb6-eb7027de1049 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:03.120334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c3cc23c-327a-459b-aeb6-eb7027de1049 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:03.120334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c3cc23c-327a-459b-aeb6-eb7027de1049 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:03.134478 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:03.279449 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9c3cc23c-327a-459b-aeb6-eb7027de1049 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:03.288747 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9c3cc23c-327a-459b-aeb6-eb7027de1049 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.186476 Jun 28 12:05:03.289385 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 34/85] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:03 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:03.610021 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cce2b65c-b839-467c-9559-d2611634dbb8 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:03.611868 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cce2b65c-b839-467c-9559-d2611634dbb8 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:03.620477 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cce2b65c-b839-467c-9559-d2611634dbb8 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:03.621049 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cce2b65c-b839-467c-9559-d2611634dbb8 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:03.621885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cce2b65c-b839-467c-9559-d2611634dbb8 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:03.622322 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cce2b65c-b839-467c-9559-d2611634dbb8 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:03.760102 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cce2b65c-b839-467c-9559-d2611634dbb8 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:03.773057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cce2b65c-b839-467c-9559-d2611634dbb8 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.172936 Jun 28 12:05:03.773851 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 52/86] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:03 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:03.833650 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e84fd102-bda7-4798-83f7-7c0c8dda1da0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:03.834293 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e84fd102-bda7-4798-83f7-7c0c8dda1da0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:03.836358 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:03.841823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e84fd102-bda7-4798-83f7-7c0c8dda1da0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:03.842632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e84fd102-bda7-4798-83f7-7c0c8dda1da0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:03.843549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e84fd102-bda7-4798-83f7-7c0c8dda1da0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:03.843836 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e84fd102-bda7-4798-83f7-7c0c8dda1da0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:03.901347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f6885a79-8180-425f-963f-fd308736219e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:03.901962 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f6885a79-8180-425f-963f-fd308736219e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:03.909167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6885a79-8180-425f-963f-fd308736219e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:03.909833 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6885a79-8180-425f-963f-fd308736219e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:03.910611 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6885a79-8180-425f-963f-fd308736219e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:03.911048 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6885a79-8180-425f-963f-fd308736219e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:03.979444 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f6885a79-8180-425f-963f-fd308736219e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:03.987523 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f6885a79-8180-425f-963f-fd308736219e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1240 microversion: 2.1 time: 0.090345 Jun 28 12:05:03.989122 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 53/87] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:03 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:03.991219 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e84fd102-bda7-4798-83f7-7c0c8dda1da0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:03.999648 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e84fd102-bda7-4798-83f7-7c0c8dda1da0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:04.001188 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e84fd102-bda7-4798-83f7-7c0c8dda1da0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:04.002296 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e84fd102-bda7-4798-83f7-7c0c8dda1da0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.172572 Jun 28 12:05:04.005819 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 35/88] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:03 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:04.306218 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-304b7a85-b15d-427b-9b60-13a0277b3262 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:04.306976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-304b7a85-b15d-427b-9b60-13a0277b3262 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:04.313276 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-304b7a85-b15d-427b-9b60-13a0277b3262 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:04.313761 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-304b7a85-b15d-427b-9b60-13a0277b3262 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:04.314547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-304b7a85-b15d-427b-9b60-13a0277b3262 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:04.314966 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-304b7a85-b15d-427b-9b60-13a0277b3262 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:04.447870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-304b7a85-b15d-427b-9b60-13a0277b3262 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:04.455593 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-304b7a85-b15d-427b-9b60-13a0277b3262 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.153602 Jun 28 12:05:04.460386 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 54/89] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:04 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:04.793396 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c4baa571-c0fb-4717-b887-882718c63e1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:04.794008 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c4baa571-c0fb-4717-b887-882718c63e1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:04.800160 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4baa571-c0fb-4717-b887-882718c63e1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:04.800613 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4baa571-c0fb-4717-b887-882718c63e1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:04.801431 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4baa571-c0fb-4717-b887-882718c63e1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:04.803075 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4baa571-c0fb-4717-b887-882718c63e1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:04.936959 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4baa571-c0fb-4717-b887-882718c63e1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:04.947245 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c4baa571-c0fb-4717-b887-882718c63e1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.158438 Jun 28 12:05:04.947900 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 36/90] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:04 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:05.007608 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b16be005-ee72-4d75-a93b-289bef3c384b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:05.008221 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b16be005-ee72-4d75-a93b-289bef3c384b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:05.014960 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b16be005-ee72-4d75-a93b-289bef3c384b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:05.015672 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b16be005-ee72-4d75-a93b-289bef3c384b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:05.016443 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b16be005-ee72-4d75-a93b-289bef3c384b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:05.016879 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b16be005-ee72-4d75-a93b-289bef3c384b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:05.020249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-66554c33-84cc-4823-93da-7fea717aeddc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:05.020873 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-66554c33-84cc-4823-93da-7fea717aeddc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:05.027462 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66554c33-84cc-4823-93da-7fea717aeddc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:05.027949 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66554c33-84cc-4823-93da-7fea717aeddc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:05.028895 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66554c33-84cc-4823-93da-7fea717aeddc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:05.029390 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66554c33-84cc-4823-93da-7fea717aeddc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:05.121220 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b16be005-ee72-4d75-a93b-289bef3c384b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:05.129213 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b16be005-ee72-4d75-a93b-289bef3c384b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1240 microversion: 2.1 time: 0.127221 Jun 28 12:05:05.129901 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 55/91] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:05 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1240 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:05.183545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66554c33-84cc-4823-93da-7fea717aeddc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:05.192396 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66554c33-84cc-4823-93da-7fea717aeddc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:05.194050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66554c33-84cc-4823-93da-7fea717aeddc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:05.195206 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-66554c33-84cc-4823-93da-7fea717aeddc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.178818 Jun 28 12:05:05.195925 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 37/92] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:05 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:05:05.471927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7b46e146-45da-454d-932f-b27e4f8747d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:05.472835 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7b46e146-45da-454d-932f-b27e4f8747d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:05.479395 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b46e146-45da-454d-932f-b27e4f8747d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:05.480047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b46e146-45da-454d-932f-b27e4f8747d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:05.481019 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b46e146-45da-454d-932f-b27e4f8747d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:05.481452 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b46e146-45da-454d-932f-b27e4f8747d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:05.631157 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7b46e146-45da-454d-932f-b27e4f8747d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:05.639412 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7b46e146-45da-454d-932f-b27e4f8747d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.171194 Jun 28 12:05:05.640091 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 56/93] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:05 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:05.964849 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-00fcacc4-692b-462f-8d76-1a601cb1e5a1 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:05.965512 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-00fcacc4-692b-462f-8d76-1a601cb1e5a1 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:05.974554 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00fcacc4-692b-462f-8d76-1a601cb1e5a1 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:05.975544 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00fcacc4-692b-462f-8d76-1a601cb1e5a1 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:05.979121 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00fcacc4-692b-462f-8d76-1a601cb1e5a1 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:05.979811 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00fcacc4-692b-462f-8d76-1a601cb1e5a1 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:06.040185 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-5fbd9db1-38b1-4b93-a76d-f69f8c53bc88 req-9eaa19c5-83b3-4c29-9258-05d2fcadf610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "350964d7-7d2a-4335-b45e-c50e8cd87f7d", "tag": "5f8ebf1b-007a-4caf-9a83-c43616b46917"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:06.049736 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5fbd9db1-38b1-4b93-a76d-f69f8c53bc88 req-9eaa19c5-83b3-4c29-9258-05d2fcadf610 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:06.050463 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5fbd9db1-38b1-4b93-a76d-f69f8c53bc88 req-9eaa19c5-83b3-4c29-9258-05d2fcadf610 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:06.064451 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-5fbd9db1-38b1-4b93-a76d-f69f8c53bc88 req-9eaa19c5-83b3-4c29-9258-05d2fcadf610 service nova] Creating event network-changed:5f8ebf1b-007a-4caf-9a83-c43616b46917 for instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d on hv-cinder-84795 Jun 28 12:05:06.081438 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-5fbd9db1-38b1-4b93-a76d-f69f8c53bc88 req-9eaa19c5-83b3-4c29-9258-05d2fcadf610 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044501 Jun 28 12:05:06.082077 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 57/94] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:05:06.152576 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1912b209-b28a-40eb-a9ce-f340056812a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:06.153699 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1912b209-b28a-40eb-a9ce-f340056812a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:06.162648 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1912b209-b28a-40eb-a9ce-f340056812a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:06.163208 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1912b209-b28a-40eb-a9ce-f340056812a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:06.164287 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1912b209-b28a-40eb-a9ce-f340056812a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:06.165006 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1912b209-b28a-40eb-a9ce-f340056812a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:06.241173 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1912b209-b28a-40eb-a9ce-f340056812a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:06.249032 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1912b209-b28a-40eb-a9ce-f340056812a1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1288 microversion: 2.1 time: 0.105827 Jun 28 12:05:06.249922 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 58/95] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:06 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:06.254453 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f552e1c7-5b3d-479a-b4ea-4acb09a988e9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:06.255328 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f552e1c7-5b3d-479a-b4ea-4acb09a988e9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:06.261792 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f552e1c7-5b3d-479a-b4ea-4acb09a988e9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:06.261928 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-00fcacc4-692b-462f-8d76-1a601cb1e5a1 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:06.262234 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f552e1c7-5b3d-479a-b4ea-4acb09a988e9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:06.262998 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f552e1c7-5b3d-479a-b4ea-4acb09a988e9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:06.263426 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f552e1c7-5b3d-479a-b4ea-4acb09a988e9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:06.269315 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-00fcacc4-692b-462f-8d76-1a601cb1e5a1 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.309553 Jun 28 12:05:06.269885 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 38/96] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:05 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:06.392931 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f552e1c7-5b3d-479a-b4ea-4acb09a988e9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:06.401145 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f552e1c7-5b3d-479a-b4ea-4acb09a988e9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:06.402659 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f552e1c7-5b3d-479a-b4ea-4acb09a988e9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:06.403777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f552e1c7-5b3d-479a-b4ea-4acb09a988e9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.152884 Jun 28 12:05:06.404356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 59/97] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:06 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:06.661328 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7fb3ad0c-3b56-404d-ac9b-debeb25276c6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:06.662363 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7fb3ad0c-3b56-404d-ac9b-debeb25276c6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:06.669228 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fb3ad0c-3b56-404d-ac9b-debeb25276c6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:06.669675 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fb3ad0c-3b56-404d-ac9b-debeb25276c6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:06.670436 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fb3ad0c-3b56-404d-ac9b-debeb25276c6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:06.670863 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fb3ad0c-3b56-404d-ac9b-debeb25276c6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:06.808655 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7fb3ad0c-3b56-404d-ac9b-debeb25276c6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:06.816271 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7fb3ad0c-3b56-404d-ac9b-debeb25276c6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.161584 Jun 28 12:05:06.816840 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 39/98] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:06 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:07.268706 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6a291867-6086-4d6c-9d95-c70cbea78c09 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:07.269898 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6a291867-6086-4d6c-9d95-c70cbea78c09 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:07.272000 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=4 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:07.278945 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a291867-6086-4d6c-9d95-c70cbea78c09 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:07.279404 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a291867-6086-4d6c-9d95-c70cbea78c09 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:07.281448 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a291867-6086-4d6c-9d95-c70cbea78c09 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:07.281448 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a291867-6086-4d6c-9d95-c70cbea78c09 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:07.281448 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=32 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:07.286772 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0bd59ccf-e84a-4393-b8ca-d0c5f09c799d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:07.287424 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0bd59ccf-e84a-4393-b8ca-d0c5f09c799d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:07.294184 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bd59ccf-e84a-4393-b8ca-d0c5f09c799d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:07.294638 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bd59ccf-e84a-4393-b8ca-d0c5f09c799d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:07.295646 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bd59ccf-e84a-4393-b8ca-d0c5f09c799d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:07.296240 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0bd59ccf-e84a-4393-b8ca-d0c5f09c799d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:07.363057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6a291867-6086-4d6c-9d95-c70cbea78c09 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:07.371873 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6a291867-6086-4d6c-9d95-c70cbea78c09 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1288 microversion: 2.1 time: 0.108237 Jun 28 12:05:07.372461 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 60/99] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:07 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:07.421388 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3fdd3eec-dabe-4dad-813b-f0ae77591c6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:07.421895 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3fdd3eec-dabe-4dad-813b-f0ae77591c6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:07.429894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3fdd3eec-dabe-4dad-813b-f0ae77591c6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:07.430574 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3fdd3eec-dabe-4dad-813b-f0ae77591c6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:07.431503 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3fdd3eec-dabe-4dad-813b-f0ae77591c6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:07.432092 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3fdd3eec-dabe-4dad-813b-f0ae77591c6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:07.459058 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0bd59ccf-e84a-4393-b8ca-d0c5f09c799d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:07.479990 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0bd59ccf-e84a-4393-b8ca-d0c5f09c799d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.197263 Jun 28 12:05:07.480667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 40/100] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:07 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:07.582987 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3fdd3eec-dabe-4dad-813b-f0ae77591c6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:07.595994 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3fdd3eec-dabe-4dad-813b-f0ae77591c6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:07.597888 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3fdd3eec-dabe-4dad-813b-f0ae77591c6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:07.599341 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3fdd3eec-dabe-4dad-813b-f0ae77591c6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.181851 Jun 28 12:05:07.600101 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 61/101] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:07 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:05:07.834074 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c6d151cc-5b1e-4099-8c30-3d3e4cd271a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:07.835143 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c6d151cc-5b1e-4099-8c30-3d3e4cd271a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:07.841416 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6d151cc-5b1e-4099-8c30-3d3e4cd271a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:07.841871 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6d151cc-5b1e-4099-8c30-3d3e4cd271a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:07.843008 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6d151cc-5b1e-4099-8c30-3d3e4cd271a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:07.843436 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6d151cc-5b1e-4099-8c30-3d3e4cd271a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:08.024848 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c6d151cc-5b1e-4099-8c30-3d3e4cd271a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:08.039645 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c6d151cc-5b1e-4099-8c30-3d3e4cd271a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.209533 Jun 28 12:05:08.040216 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 41/102] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:07 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:08.390346 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b27fde60-f563-46c5-8f6e-efb360f757e0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:08.391082 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b27fde60-f563-46c5-8f6e-efb360f757e0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:08.398702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b27fde60-f563-46c5-8f6e-efb360f757e0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:08.399244 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b27fde60-f563-46c5-8f6e-efb360f757e0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:08.400072 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b27fde60-f563-46c5-8f6e-efb360f757e0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:08.400500 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b27fde60-f563-46c5-8f6e-efb360f757e0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:08.463060 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b27fde60-f563-46c5-8f6e-efb360f757e0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:08.471600 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b27fde60-f563-46c5-8f6e-efb360f757e0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1288 microversion: 2.1 time: 0.085259 Jun 28 12:05:08.472174 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 62/103] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:08 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:08.496870 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-520dff53-7a19-4198-a3f8-26c36ba851bb tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:08.497501 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-520dff53-7a19-4198-a3f8-26c36ba851bb tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:08.504038 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-520dff53-7a19-4198-a3f8-26c36ba851bb tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:08.504632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-520dff53-7a19-4198-a3f8-26c36ba851bb tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:08.505470 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-520dff53-7a19-4198-a3f8-26c36ba851bb tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:08.505921 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-520dff53-7a19-4198-a3f8-26c36ba851bb tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:08.620613 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ec7951ef-851d-45d0-a8d0-d0bdb19a2869 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:08.621245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ec7951ef-851d-45d0-a8d0-d0bdb19a2869 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:08.627943 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ec7951ef-851d-45d0-a8d0-d0bdb19a2869 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:08.628600 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ec7951ef-851d-45d0-a8d0-d0bdb19a2869 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:08.629628 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ec7951ef-851d-45d0-a8d0-d0bdb19a2869 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:08.630242 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ec7951ef-851d-45d0-a8d0-d0bdb19a2869 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:08.638564 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-520dff53-7a19-4198-a3f8-26c36ba851bb tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:08.648255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-520dff53-7a19-4198-a3f8-26c36ba851bb tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.154533 Jun 28 12:05:08.648930 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 42/104] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:08 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:08.783928 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ec7951ef-851d-45d0-a8d0-d0bdb19a2869 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:08.796934 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ec7951ef-851d-45d0-a8d0-d0bdb19a2869 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:08.798357 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ec7951ef-851d-45d0-a8d0-d0bdb19a2869 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:08.799502 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ec7951ef-851d-45d0-a8d0-d0bdb19a2869 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.184435 Jun 28 12:05:08.800063 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 63/105] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:08 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:09.057343 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c423ff30-cf5e-4ae9-a036-6570b396209d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:09.057946 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c423ff30-cf5e-4ae9-a036-6570b396209d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:09.068513 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c423ff30-cf5e-4ae9-a036-6570b396209d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:09.069622 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c423ff30-cf5e-4ae9-a036-6570b396209d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:09.070489 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c423ff30-cf5e-4ae9-a036-6570b396209d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:09.070820 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c423ff30-cf5e-4ae9-a036-6570b396209d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:09.213535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c423ff30-cf5e-4ae9-a036-6570b396209d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:09.221827 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c423ff30-cf5e-4ae9-a036-6570b396209d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.168847 Jun 28 12:05:09.222385 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 43/106] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:09 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:09.488331 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a76d4a54-b06d-486a-9ebe-c59481fe6bf2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:09.488965 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a76d4a54-b06d-486a-9ebe-c59481fe6bf2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:09.495614 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a76d4a54-b06d-486a-9ebe-c59481fe6bf2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:09.496058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a76d4a54-b06d-486a-9ebe-c59481fe6bf2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:09.496834 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a76d4a54-b06d-486a-9ebe-c59481fe6bf2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:09.497294 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a76d4a54-b06d-486a-9ebe-c59481fe6bf2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:09.560783 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a76d4a54-b06d-486a-9ebe-c59481fe6bf2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:09.568364 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a76d4a54-b06d-486a-9ebe-c59481fe6bf2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1288 microversion: 2.1 time: 0.083858 Jun 28 12:05:09.569043 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 64/107] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:09 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:09.665478 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3e5cb1f5-8604-4df9-b2c8-b124f3e79cc3 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:09.666218 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3e5cb1f5-8604-4df9-b2c8-b124f3e79cc3 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:09.672572 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e5cb1f5-8604-4df9-b2c8-b124f3e79cc3 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:09.673064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e5cb1f5-8604-4df9-b2c8-b124f3e79cc3 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:09.673836 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e5cb1f5-8604-4df9-b2c8-b124f3e79cc3 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:09.674267 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e5cb1f5-8604-4df9-b2c8-b124f3e79cc3 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:09.815268 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3e5cb1f5-8604-4df9-b2c8-b124f3e79cc3 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:09.818237 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2a25b000-7a82-4da4-96b8-e1afa63ea7ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:09.819296 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2a25b000-7a82-4da4-96b8-e1afa63ea7ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:09.823860 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3e5cb1f5-8604-4df9-b2c8-b124f3e79cc3 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.162452 Jun 28 12:05:09.824648 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 44/108] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:09 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:09.825439 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a25b000-7a82-4da4-96b8-e1afa63ea7ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:09.830523 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a25b000-7a82-4da4-96b8-e1afa63ea7ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:09.830523 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a25b000-7a82-4da4-96b8-e1afa63ea7ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:09.830523 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a25b000-7a82-4da4-96b8-e1afa63ea7ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:09.958984 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2a25b000-7a82-4da4-96b8-e1afa63ea7ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:09.962904 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:09.969388 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2a25b000-7a82-4da4-96b8-e1afa63ea7ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:09.970900 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2a25b000-7a82-4da4-96b8-e1afa63ea7ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:09.972019 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2a25b000-7a82-4da4-96b8-e1afa63ea7ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.158111 Jun 28 12:05:09.972576 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 65/109] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:09 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:10.238107 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7c6ba678-5dc3-4864-9567-b4346f64849c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:10.238734 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7c6ba678-5dc3-4864-9567-b4346f64849c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:10.245620 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c6ba678-5dc3-4864-9567-b4346f64849c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:10.246037 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c6ba678-5dc3-4864-9567-b4346f64849c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:10.246815 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c6ba678-5dc3-4864-9567-b4346f64849c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:10.247241 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c6ba678-5dc3-4864-9567-b4346f64849c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:10.385430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7c6ba678-5dc3-4864-9567-b4346f64849c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:10.394505 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7c6ba678-5dc3-4864-9567-b4346f64849c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.160361 Jun 28 12:05:10.395105 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 45/110] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:10 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:10.586016 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3f0955d6-c418-4d69-b11d-11110a9a0b66 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:10.586633 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3f0955d6-c418-4d69-b11d-11110a9a0b66 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:10.593239 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f0955d6-c418-4d69-b11d-11110a9a0b66 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:10.593693 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f0955d6-c418-4d69-b11d-11110a9a0b66 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:10.594489 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f0955d6-c418-4d69-b11d-11110a9a0b66 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:10.594875 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f0955d6-c418-4d69-b11d-11110a9a0b66 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:10.662047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3f0955d6-c418-4d69-b11d-11110a9a0b66 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:10.670239 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3f0955d6-c418-4d69-b11d-11110a9a0b66 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1288 microversion: 2.1 time: 0.088610 Jun 28 12:05:10.670802 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 66/111] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:10 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:10.841771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-212b1d35-b20a-469e-bcd6-d1950022a297 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:10.842713 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-212b1d35-b20a-469e-bcd6-d1950022a297 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:10.849237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-212b1d35-b20a-469e-bcd6-d1950022a297 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:10.849744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-212b1d35-b20a-469e-bcd6-d1950022a297 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:10.851079 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-212b1d35-b20a-469e-bcd6-d1950022a297 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:10.851525 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-212b1d35-b20a-469e-bcd6-d1950022a297 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:10.985137 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-212b1d35-b20a-469e-bcd6-d1950022a297 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:10.991507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-be255356-2082-4c43-a742-4f2dd294a7d3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:10.992341 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-be255356-2082-4c43-a742-4f2dd294a7d3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:10.993631 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-212b1d35-b20a-469e-bcd6-d1950022a297 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.155642 Jun 28 12:05:10.994435 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 46/112] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:10 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:11.004744 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be255356-2082-4c43-a742-4f2dd294a7d3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:11.005353 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be255356-2082-4c43-a742-4f2dd294a7d3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:11.006571 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be255356-2082-4c43-a742-4f2dd294a7d3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:11.007036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be255356-2082-4c43-a742-4f2dd294a7d3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:11.154010 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-be255356-2082-4c43-a742-4f2dd294a7d3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:11.161985 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-be255356-2082-4c43-a742-4f2dd294a7d3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:11.163560 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-be255356-2082-4c43-a742-4f2dd294a7d3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:11.164672 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-be255356-2082-4c43-a742-4f2dd294a7d3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.178720 Jun 28 12:05:11.165268 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 67/113] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:10 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:11.412274 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2ca4eb40-f657-43e9-a05c-795cd32f34f8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:11.413186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2ca4eb40-f657-43e9-a05c-795cd32f34f8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:11.419465 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ca4eb40-f657-43e9-a05c-795cd32f34f8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:11.419918 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ca4eb40-f657-43e9-a05c-795cd32f34f8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:11.420703 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ca4eb40-f657-43e9-a05c-795cd32f34f8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:11.421161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ca4eb40-f657-43e9-a05c-795cd32f34f8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:11.556309 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2ca4eb40-f657-43e9-a05c-795cd32f34f8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:11.564560 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2ca4eb40-f657-43e9-a05c-795cd32f34f8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.156456 Jun 28 12:05:11.565161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 47/114] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:11 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:11.687520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8e04d120-3c30-4cf9-b0ca-caaeb6bd2198 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:11.688158 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8e04d120-3c30-4cf9-b0ca-caaeb6bd2198 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:11.695205 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e04d120-3c30-4cf9-b0ca-caaeb6bd2198 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:11.695639 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e04d120-3c30-4cf9-b0ca-caaeb6bd2198 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:11.696460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e04d120-3c30-4cf9-b0ca-caaeb6bd2198 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:11.697005 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e04d120-3c30-4cf9-b0ca-caaeb6bd2198 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:11.784769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8e04d120-3c30-4cf9-b0ca-caaeb6bd2198 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:11.793996 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8e04d120-3c30-4cf9-b0ca-caaeb6bd2198 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1288 microversion: 2.1 time: 0.110295 Jun 28 12:05:11.795103 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 68/115] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:11 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1288 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:12.011072 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c5a17729-be75-48b6-a844-283c56ec19e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:12.011704 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c5a17729-be75-48b6-a844-283c56ec19e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:12.017731 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5a17729-be75-48b6-a844-283c56ec19e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:12.018170 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5a17729-be75-48b6-a844-283c56ec19e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:12.018930 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5a17729-be75-48b6-a844-283c56ec19e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:12.019365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5a17729-be75-48b6-a844-283c56ec19e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:12.172373 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c5a17729-be75-48b6-a844-283c56ec19e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:12.182495 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c5a17729-be75-48b6-a844-283c56ec19e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.175599 Jun 28 12:05:12.183819 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 48/116] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:12 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:12.184613 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4e1aaae1-4c76-49cd-a7c4-3d6f546434c3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:12.185310 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4e1aaae1-4c76-49cd-a7c4-3d6f546434c3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:12.191458 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e1aaae1-4c76-49cd-a7c4-3d6f546434c3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:12.191894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e1aaae1-4c76-49cd-a7c4-3d6f546434c3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:12.192673 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e1aaae1-4c76-49cd-a7c4-3d6f546434c3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:12.193125 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e1aaae1-4c76-49cd-a7c4-3d6f546434c3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:12.360673 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4e1aaae1-4c76-49cd-a7c4-3d6f546434c3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:12.369326 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4e1aaae1-4c76-49cd-a7c4-3d6f546434c3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:12.370835 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4e1aaae1-4c76-49cd-a7c4-3d6f546434c3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:12.371957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4e1aaae1-4c76-49cd-a7c4-3d6f546434c3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.191982 Jun 28 12:05:12.372542 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 69/117] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:12 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:05:12.581152 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-250d53ff-9c99-48a6-87ad-41eb2fb96c61 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:12.581767 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-250d53ff-9c99-48a6-87ad-41eb2fb96c61 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:12.588052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-250d53ff-9c99-48a6-87ad-41eb2fb96c61 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:12.588512 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-250d53ff-9c99-48a6-87ad-41eb2fb96c61 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:12.589304 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-250d53ff-9c99-48a6-87ad-41eb2fb96c61 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:12.589741 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-250d53ff-9c99-48a6-87ad-41eb2fb96c61 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:12.737322 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-250d53ff-9c99-48a6-87ad-41eb2fb96c61 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:12.749512 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-250d53ff-9c99-48a6-87ad-41eb2fb96c61 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.172184 Jun 28 12:05:12.750113 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 49/118] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:12 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:12.814042 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5d399416-4fb0-4381-a5fc-012074e9db1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:12.814657 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5d399416-4fb0-4381-a5fc-012074e9db1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:12.823018 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5d399416-4fb0-4381-a5fc-012074e9db1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:12.823772 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5d399416-4fb0-4381-a5fc-012074e9db1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:12.824577 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5d399416-4fb0-4381-a5fc-012074e9db1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:12.825062 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5d399416-4fb0-4381-a5fc-012074e9db1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:12.896140 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5d399416-4fb0-4381-a5fc-012074e9db1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:12.905887 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5d399416-4fb0-4381-a5fc-012074e9db1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1288 microversion: 2.1 time: 0.096110 Jun 28 12:05:12.906704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 70/119] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:12 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:13.209711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2fe93ec7-9395-4068-bdbc-345f4bf97360 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:13.211153 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2fe93ec7-9395-4068-bdbc-345f4bf97360 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:13.221074 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fe93ec7-9395-4068-bdbc-345f4bf97360 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:13.222421 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fe93ec7-9395-4068-bdbc-345f4bf97360 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:13.224534 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fe93ec7-9395-4068-bdbc-345f4bf97360 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:13.225255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fe93ec7-9395-4068-bdbc-345f4bf97360 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:13.390360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-81385b60-0130-42e1-9bd1-401b96d47696 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:13.390983 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-81385b60-0130-42e1-9bd1-401b96d47696 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:13.398524 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81385b60-0130-42e1-9bd1-401b96d47696 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:13.399258 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81385b60-0130-42e1-9bd1-401b96d47696 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:13.400239 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81385b60-0130-42e1-9bd1-401b96d47696 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:13.400949 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81385b60-0130-42e1-9bd1-401b96d47696 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:13.854395 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2fe93ec7-9395-4068-bdbc-345f4bf97360 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:13.858564 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:13.863754 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-81385b60-0130-42e1-9bd1-401b96d47696 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:13.868354 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2fe93ec7-9395-4068-bdbc-345f4bf97360 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.671665 Jun 28 12:05:13.869583 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 50/120] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:13 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:13.875233 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-81385b60-0130-42e1-9bd1-401b96d47696 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:13.881975 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-81385b60-0130-42e1-9bd1-401b96d47696 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:13.882676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8b774f1c-7edb-45d3-8c7f-e49476c6fdeb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:13.885313 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8b774f1c-7edb-45d3-8c7f-e49476c6fdeb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:13.886280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-81385b60-0130-42e1-9bd1-401b96d47696 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.499209 Jun 28 12:05:13.888950 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 71/121] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:13 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:05:13.907341 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8b774f1c-7edb-45d3-8c7f-e49476c6fdeb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:13.908051 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8b774f1c-7edb-45d3-8c7f-e49476c6fdeb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:13.909136 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8b774f1c-7edb-45d3-8c7f-e49476c6fdeb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:13.909820 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8b774f1c-7edb-45d3-8c7f-e49476c6fdeb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:13.923642 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-df94577b-0f65-44ad-b51d-724fe919eddd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:13.935554 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-df94577b-0f65-44ad-b51d-724fe919eddd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:13.956664 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df94577b-0f65-44ad-b51d-724fe919eddd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:13.957427 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df94577b-0f65-44ad-b51d-724fe919eddd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:13.961894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df94577b-0f65-44ad-b51d-724fe919eddd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:13.965496 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-df94577b-0f65-44ad-b51d-724fe919eddd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:14.324420 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-df94577b-0f65-44ad-b51d-724fe919eddd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:14.333439 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-df94577b-0f65-44ad-b51d-724fe919eddd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1294 microversion: 2.1 time: 0.414209 Jun 28 12:05:14.336896 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 72/122] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:13 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1294 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:14.769538 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8b774f1c-7edb-45d3-8c7f-e49476c6fdeb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:14.781232 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8b774f1c-7edb-45d3-8c7f-e49476c6fdeb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.909400 Jun 28 12:05:14.788641 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 51/123] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:13 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:14.887278 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bd1b3401-e9d6-444e-b740-32de88802d9d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:14.888012 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bd1b3401-e9d6-444e-b740-32de88802d9d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:14.896412 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bd1b3401-e9d6-444e-b740-32de88802d9d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:14.899747 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bd1b3401-e9d6-444e-b740-32de88802d9d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:14.901424 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bd1b3401-e9d6-444e-b740-32de88802d9d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:14.901879 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bd1b3401-e9d6-444e-b740-32de88802d9d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:14.906120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-26e8da8c-c857-481a-821a-fa1460256ffc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:14.906766 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-26e8da8c-c857-481a-821a-fa1460256ffc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:14.915725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26e8da8c-c857-481a-821a-fa1460256ffc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:14.916356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26e8da8c-c857-481a-821a-fa1460256ffc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:14.917266 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26e8da8c-c857-481a-821a-fa1460256ffc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:14.917706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-26e8da8c-c857-481a-821a-fa1460256ffc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:15.158444 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-26e8da8c-c857-481a-821a-fa1460256ffc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:15.173822 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-26e8da8c-c857-481a-821a-fa1460256ffc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:15.179791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-26e8da8c-c857-481a-821a-fa1460256ffc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:15.181620 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-26e8da8c-c857-481a-821a-fa1460256ffc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.280402 Jun 28 12:05:15.182408 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 52/124] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:14 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:05:15.360180 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-84f82ce5-47e7-4373-ba0b-04c1e12a5d3d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:15.361039 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-84f82ce5-47e7-4373-ba0b-04c1e12a5d3d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:15.372424 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84f82ce5-47e7-4373-ba0b-04c1e12a5d3d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:15.374767 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84f82ce5-47e7-4373-ba0b-04c1e12a5d3d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:15.377288 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84f82ce5-47e7-4373-ba0b-04c1e12a5d3d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:15.377596 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-84f82ce5-47e7-4373-ba0b-04c1e12a5d3d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:15.416266 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bd1b3401-e9d6-444e-b740-32de88802d9d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:15.436777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bd1b3401-e9d6-444e-b740-32de88802d9d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.551884 Jun 28 12:05:15.449043 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 73/125] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:14 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:15.675753 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-84f82ce5-47e7-4373-ba0b-04c1e12a5d3d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:15.701239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-84f82ce5-47e7-4373-ba0b-04c1e12a5d3d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.350404 Jun 28 12:05:15.711662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 53/126] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:15 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:15.808965 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4928a338-b7c6-43ea-8ae7-3f6f093eded4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:15.812426 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4928a338-b7c6-43ea-8ae7-3f6f093eded4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:15.844598 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4928a338-b7c6-43ea-8ae7-3f6f093eded4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:15.852302 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4928a338-b7c6-43ea-8ae7-3f6f093eded4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:15.855101 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4928a338-b7c6-43ea-8ae7-3f6f093eded4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:15.855558 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4928a338-b7c6-43ea-8ae7-3f6f093eded4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:16.152745 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4928a338-b7c6-43ea-8ae7-3f6f093eded4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:16.170571 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4928a338-b7c6-43ea-8ae7-3f6f093eded4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.366271 Jun 28 12:05:16.171150 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 74/127] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:15 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:16.200767 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c183a4dc-d3ea-4891-8878-7232cfd785ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:16.202714 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c183a4dc-d3ea-4891-8878-7232cfd785ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:16.211654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c183a4dc-d3ea-4891-8878-7232cfd785ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:16.212477 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c183a4dc-d3ea-4891-8878-7232cfd785ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:16.213820 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c183a4dc-d3ea-4891-8878-7232cfd785ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:16.214611 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c183a4dc-d3ea-4891-8878-7232cfd785ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:16.386842 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-79ec02e4-6541-49b5-8486-eeed8dd6cff1 req-cb833d33-bbf8-4eb8-9551-0b80a8eb61ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fea86db2-6a76-4e24-b41c-ab22b7f1d759", "name": "network-vif-plugged", "status": "completed", "tag": "63424f2c-afc9-4ae8-835f-0daf13f6f344"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:16.395993 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-79ec02e4-6541-49b5-8486-eeed8dd6cff1 req-cb833d33-bbf8-4eb8-9551-0b80a8eb61ad service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:16.396440 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-79ec02e4-6541-49b5-8486-eeed8dd6cff1 req-cb833d33-bbf8-4eb8-9551-0b80a8eb61ad service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:16.409769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-79ec02e4-6541-49b5-8486-eeed8dd6cff1 req-cb833d33-bbf8-4eb8-9551-0b80a8eb61ad service nova] Creating event network-vif-plugged:63424f2c-afc9-4ae8-835f-0daf13f6f344 for instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 on hv-cinder-84795 Jun 28 12:05:16.415197 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-79ec02e4-6541-49b5-8486-eeed8dd6cff1 req-cb833d33-bbf8-4eb8-9551-0b80a8eb61ad service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109724 Jun 28 12:05:16.416881 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 75/128] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:05:16.439608 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c183a4dc-d3ea-4891-8878-7232cfd785ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:16.447757 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c183a4dc-d3ea-4891-8878-7232cfd785ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:16.449326 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c183a4dc-d3ea-4891-8878-7232cfd785ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:16.450437 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c183a4dc-d3ea-4891-8878-7232cfd785ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.254222 Jun 28 12:05:16.450990 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 54/129] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:16 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:16.465773 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9f5cc9f1-78b6-4f61-9d21-433f00686196 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:16.466474 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9f5cc9f1-78b6-4f61-9d21-433f00686196 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:16.473459 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9f5cc9f1-78b6-4f61-9d21-433f00686196 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:16.473907 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9f5cc9f1-78b6-4f61-9d21-433f00686196 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:16.474696 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9f5cc9f1-78b6-4f61-9d21-433f00686196 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:16.475198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9f5cc9f1-78b6-4f61-9d21-433f00686196 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:16.636249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9f5cc9f1-78b6-4f61-9d21-433f00686196 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:16.647918 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9f5cc9f1-78b6-4f61-9d21-433f00686196 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.185693 Jun 28 12:05:16.649165 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 76/130] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:16 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:16.720612 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-29b5afad-99e5-4d8f-8cfe-5f269514ce01 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:16.721261 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-29b5afad-99e5-4d8f-8cfe-5f269514ce01 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:16.727711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29b5afad-99e5-4d8f-8cfe-5f269514ce01 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:16.728394 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29b5afad-99e5-4d8f-8cfe-5f269514ce01 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:16.729190 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29b5afad-99e5-4d8f-8cfe-5f269514ce01 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:16.729652 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29b5afad-99e5-4d8f-8cfe-5f269514ce01 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:16.880269 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-29b5afad-99e5-4d8f-8cfe-5f269514ce01 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:16.889337 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-29b5afad-99e5-4d8f-8cfe-5f269514ce01 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.173163 Jun 28 12:05:16.889907 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 55/131] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:16 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:17.187432 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-592593bb-e100-49aa-a4f3-3bdc63b92bd7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:17.188101 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-592593bb-e100-49aa-a4f3-3bdc63b92bd7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:17.198396 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-592593bb-e100-49aa-a4f3-3bdc63b92bd7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:17.199101 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-592593bb-e100-49aa-a4f3-3bdc63b92bd7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:17.203963 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-592593bb-e100-49aa-a4f3-3bdc63b92bd7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:17.204773 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-592593bb-e100-49aa-a4f3-3bdc63b92bd7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:17.474738 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c5879dc9-a4c0-441e-9d82-7ecfa500c261 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:17.476063 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c5879dc9-a4c0-441e-9d82-7ecfa500c261 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:17.490460 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5879dc9-a4c0-441e-9d82-7ecfa500c261 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:17.491474 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5879dc9-a4c0-441e-9d82-7ecfa500c261 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:17.495238 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5879dc9-a4c0-441e-9d82-7ecfa500c261 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:17.495864 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5879dc9-a4c0-441e-9d82-7ecfa500c261 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:17.667944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c5879dc9-a4c0-441e-9d82-7ecfa500c261 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:17.698552 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c5879dc9-a4c0-441e-9d82-7ecfa500c261 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:17.704289 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c5879dc9-a4c0-441e-9d82-7ecfa500c261 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:17.707465 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c5879dc9-a4c0-441e-9d82-7ecfa500c261 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.241537 Jun 28 12:05:17.709319 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 56/132] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:17 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:17.716409 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3d94436e-430d-41ea-b323-8ba22504972c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:17.718309 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3d94436e-430d-41ea-b323-8ba22504972c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:17.727356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d94436e-430d-41ea-b323-8ba22504972c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:17.728547 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d94436e-430d-41ea-b323-8ba22504972c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:17.730030 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d94436e-430d-41ea-b323-8ba22504972c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:17.730709 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d94436e-430d-41ea-b323-8ba22504972c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:17.803445 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-592593bb-e100-49aa-a4f3-3bdc63b92bd7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:17.814385 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-592593bb-e100-49aa-a4f3-3bdc63b92bd7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.630767 Jun 28 12:05:17.815285 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 77/133] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:17 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:17.906371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b477301b-36e0-4e99-885a-f57a952c8b89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:17.906992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b477301b-36e0-4e99-885a-f57a952c8b89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:17.913911 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b477301b-36e0-4e99-885a-f57a952c8b89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:17.918237 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b477301b-36e0-4e99-885a-f57a952c8b89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:17.924173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3d94436e-430d-41ea-b323-8ba22504972c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:17.931418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b477301b-36e0-4e99-885a-f57a952c8b89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:17.933173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3d94436e-430d-41ea-b323-8ba22504972c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.222469 Jun 28 12:05:17.934430 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b477301b-36e0-4e99-885a-f57a952c8b89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:17.934540 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 57/134] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:17 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:18.232570 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b477301b-36e0-4e99-885a-f57a952c8b89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:18.244314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b477301b-36e0-4e99-885a-f57a952c8b89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.341753 Jun 28 12:05:18.245274 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 78/135] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:17 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:18.398811 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-2cfc651f-a599-4f09-96f9-00bcaa55cf2d req-c31f777c-c204-4f90-9365-508b00611145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed81e0c7-a44e-497b-bf2e-cf208dd340de", "tag": "66e19dd9-9d9b-4c52-9617-acf66e3f62d9"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:18.415769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-2cfc651f-a599-4f09-96f9-00bcaa55cf2d req-c31f777c-c204-4f90-9365-508b00611145 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:18.422331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-2cfc651f-a599-4f09-96f9-00bcaa55cf2d req-c31f777c-c204-4f90-9365-508b00611145 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:18.440532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-2cfc651f-a599-4f09-96f9-00bcaa55cf2d req-c31f777c-c204-4f90-9365-508b00611145 service nova] Creating event network-changed:66e19dd9-9d9b-4c52-9617-acf66e3f62d9 for instance ed81e0c7-a44e-497b-bf2e-cf208dd340de on hv-cinder-84795 Jun 28 12:05:18.446330 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-2cfc651f-a599-4f09-96f9-00bcaa55cf2d req-c31f777c-c204-4f90-9365-508b00611145 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052365 Jun 28 12:05:18.450303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 58/136] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:05:18.734288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c37132fd-7ebd-437b-b2e6-787bf4b3cfeb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:18.737328 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c37132fd-7ebd-437b-b2e6-787bf4b3cfeb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:18.745397 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:18.765342 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c37132fd-7ebd-437b-b2e6-787bf4b3cfeb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:18.765810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c37132fd-7ebd-437b-b2e6-787bf4b3cfeb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:18.766570 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c37132fd-7ebd-437b-b2e6-787bf4b3cfeb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:18.767012 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c37132fd-7ebd-437b-b2e6-787bf4b3cfeb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:18.831907 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2ac7a2d5-aa52-4271-bb8e-ddd533c938d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:18.832651 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2ac7a2d5-aa52-4271-bb8e-ddd533c938d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:18.856864 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ac7a2d5-aa52-4271-bb8e-ddd533c938d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:18.857351 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ac7a2d5-aa52-4271-bb8e-ddd533c938d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:18.858123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ac7a2d5-aa52-4271-bb8e-ddd533c938d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:18.858551 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2ac7a2d5-aa52-4271-bb8e-ddd533c938d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:19.031861 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c37132fd-7ebd-437b-b2e6-787bf4b3cfeb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:19.046636 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c37132fd-7ebd-437b-b2e6-787bf4b3cfeb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:19.050144 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c37132fd-7ebd-437b-b2e6-787bf4b3cfeb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:19.052144 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c37132fd-7ebd-437b-b2e6-787bf4b3cfeb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.327081 Jun 28 12:05:19.057339 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 79/137] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:18 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:19.068825 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1d3588f4-f3da-4d0a-8d6e-6bbd571bac9c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:19.070167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1d3588f4-f3da-4d0a-8d6e-6bbd571bac9c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:19.076964 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1d3588f4-f3da-4d0a-8d6e-6bbd571bac9c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:19.077531 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1d3588f4-f3da-4d0a-8d6e-6bbd571bac9c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:19.078387 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1d3588f4-f3da-4d0a-8d6e-6bbd571bac9c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:19.078895 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1d3588f4-f3da-4d0a-8d6e-6bbd571bac9c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:19.098687 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2ac7a2d5-aa52-4271-bb8e-ddd533c938d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:19.108378 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2ac7a2d5-aa52-4271-bb8e-ddd533c938d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.280612 Jun 28 12:05:19.109729 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 59/138] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:18 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:19.245239 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1d3588f4-f3da-4d0a-8d6e-6bbd571bac9c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:19.252994 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1d3588f4-f3da-4d0a-8d6e-6bbd571bac9c tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.193963 Jun 28 12:05:19.253655 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 80/139] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:19 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:19.261814 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7bc36e68-c6f2-467d-8d58-e5d704eb7274 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:19.262483 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7bc36e68-c6f2-467d-8d58-e5d704eb7274 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:19.268948 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bc36e68-c6f2-467d-8d58-e5d704eb7274 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:19.269436 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bc36e68-c6f2-467d-8d58-e5d704eb7274 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:19.270494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bc36e68-c6f2-467d-8d58-e5d704eb7274 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:19.271016 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7bc36e68-c6f2-467d-8d58-e5d704eb7274 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:19.436405 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7bc36e68-c6f2-467d-8d58-e5d704eb7274 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:19.445492 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7bc36e68-c6f2-467d-8d58-e5d704eb7274 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.187655 Jun 28 12:05:19.446896 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 60/140] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:19 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:20.072859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9b72ed12-0fd6-4f32-968b-8f76766d1d53 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:20.073905 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9b72ed12-0fd6-4f32-968b-8f76766d1d53 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:20.099357 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-36555f65-f8c9-4e38-a5c9-378965956d5f req-7ad4cf16-ead4-4569-b7a2-af687d0ad461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46baa815-7582-46ae-a0ea-3d29be972512", "name": "network-vif-plugged", "status": "completed", "tag": "5b57bf11-d959-4b21-a64c-807b0e2c9f63"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:20.101705 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b72ed12-0fd6-4f32-968b-8f76766d1d53 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:20.110831 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b72ed12-0fd6-4f32-968b-8f76766d1d53 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:20.111741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b72ed12-0fd6-4f32-968b-8f76766d1d53 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:20.112256 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-36555f65-f8c9-4e38-a5c9-378965956d5f req-7ad4cf16-ead4-4569-b7a2-af687d0ad461 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:20.112375 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b72ed12-0fd6-4f32-968b-8f76766d1d53 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:20.112922 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-36555f65-f8c9-4e38-a5c9-378965956d5f req-7ad4cf16-ead4-4569-b7a2-af687d0ad461 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:20.133082 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-36555f65-f8c9-4e38-a5c9-378965956d5f req-7ad4cf16-ead4-4569-b7a2-af687d0ad461 service nova] Creating event network-vif-plugged:5b57bf11-d959-4b21-a64c-807b0e2c9f63 for instance 46baa815-7582-46ae-a0ea-3d29be972512 on hv-cinder-84795 Jun 28 12:05:20.142877 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-36555f65-f8c9-4e38-a5c9-378965956d5f req-7ad4cf16-ead4-4569-b7a2-af687d0ad461 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046186 Jun 28 12:05:20.145370 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 61/141] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:05:20.156333 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f1cd8a90-6eee-4eba-a600-935b06b301e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:20.157325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f1cd8a90-6eee-4eba-a600-935b06b301e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:20.170225 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1cd8a90-6eee-4eba-a600-935b06b301e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:20.170999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1cd8a90-6eee-4eba-a600-935b06b301e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:20.172503 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1cd8a90-6eee-4eba-a600-935b06b301e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:20.173504 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1cd8a90-6eee-4eba-a600-935b06b301e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:20.353113 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b72ed12-0fd6-4f32-968b-8f76766d1d53 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:20.359529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b72ed12-0fd6-4f32-968b-8f76766d1d53 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:20.361082 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b72ed12-0fd6-4f32-968b-8f76766d1d53 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:20.362777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9b72ed12-0fd6-4f32-968b-8f76766d1d53 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.295846 Jun 28 12:05:20.363552 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 81/142] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:20 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:20.378894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ebea964c-b383-41ff-b7ae-ca2d02655846 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:20.379703 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ebea964c-b383-41ff-b7ae-ca2d02655846 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:20.387584 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebea964c-b383-41ff-b7ae-ca2d02655846 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:20.388227 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebea964c-b383-41ff-b7ae-ca2d02655846 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:20.389406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebea964c-b383-41ff-b7ae-ca2d02655846 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:20.390052 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebea964c-b383-41ff-b7ae-ca2d02655846 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:20.403694 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f1cd8a90-6eee-4eba-a600-935b06b301e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:20.412814 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f1cd8a90-6eee-4eba-a600-935b06b301e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.262691 Jun 28 12:05:20.414300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 62/143] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:20 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:20.463827 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5e42251e-06d7-4f5d-83ff-8d84f446e1f0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:20.464721 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5e42251e-06d7-4f5d-83ff-8d84f446e1f0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:20.475068 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e42251e-06d7-4f5d-83ff-8d84f446e1f0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:20.476255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e42251e-06d7-4f5d-83ff-8d84f446e1f0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:20.477059 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e42251e-06d7-4f5d-83ff-8d84f446e1f0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:20.477493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e42251e-06d7-4f5d-83ff-8d84f446e1f0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:20.547904 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ebea964c-b383-41ff-b7ae-ca2d02655846 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:20.555442 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ebea964c-b383-41ff-b7ae-ca2d02655846 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.190435 Jun 28 12:05:20.556020 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 82/144] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:20 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:20.616934 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5e42251e-06d7-4f5d-83ff-8d84f446e1f0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:20.624596 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5e42251e-06d7-4f5d-83ff-8d84f446e1f0 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.165262 Jun 28 12:05:20.625289 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 63/145] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:20 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:21.382292 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3f0e6aa0-18b9-4815-8ef5-8eff320d5228 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:21.382972 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3f0e6aa0-18b9-4815-8ef5-8eff320d5228 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:21.389261 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f0e6aa0-18b9-4815-8ef5-8eff320d5228 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:21.389957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f0e6aa0-18b9-4815-8ef5-8eff320d5228 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:21.390713 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f0e6aa0-18b9-4815-8ef5-8eff320d5228 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:21.391149 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f0e6aa0-18b9-4815-8ef5-8eff320d5228 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:21.395178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:21.430701 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a3b756d8-fd61-4dea-9a49-020037454102 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:21.431309 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a3b756d8-fd61-4dea-9a49-020037454102 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:21.437765 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a3b756d8-fd61-4dea-9a49-020037454102 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:21.438220 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a3b756d8-fd61-4dea-9a49-020037454102 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:21.439068 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a3b756d8-fd61-4dea-9a49-020037454102 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:21.439430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a3b756d8-fd61-4dea-9a49-020037454102 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:21.542888 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3f0e6aa0-18b9-4815-8ef5-8eff320d5228 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:21.551071 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3f0e6aa0-18b9-4815-8ef5-8eff320d5228 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:21.552662 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3f0e6aa0-18b9-4815-8ef5-8eff320d5228 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:21.554077 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3f0e6aa0-18b9-4815-8ef5-8eff320d5228 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.175726 Jun 28 12:05:21.554716 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 83/146] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:21 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:21.572719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d7305087-f8da-4bd4-856d-9ea22cb8ed1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:21.573368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d7305087-f8da-4bd4-856d-9ea22cb8ed1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:21.581547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7305087-f8da-4bd4-856d-9ea22cb8ed1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:21.582211 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7305087-f8da-4bd4-856d-9ea22cb8ed1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:21.582978 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7305087-f8da-4bd4-856d-9ea22cb8ed1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:21.583605 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d7305087-f8da-4bd4-856d-9ea22cb8ed1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:21.634958 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a3b756d8-fd61-4dea-9a49-020037454102 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:21.642471 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a3b756d8-fd61-4dea-9a49-020037454102 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.215644 Jun 28 12:05:21.651207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 64/147] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:21 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:21.651207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f2529af3-c68d-4191-b55b-4570958db6e7 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:21.651207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f2529af3-c68d-4191-b55b-4570958db6e7 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:21.654986 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2529af3-c68d-4191-b55b-4570958db6e7 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:21.655664 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2529af3-c68d-4191-b55b-4570958db6e7 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:21.656436 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2529af3-c68d-4191-b55b-4570958db6e7 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:21.656864 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2529af3-c68d-4191-b55b-4570958db6e7 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:21.722915 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d7305087-f8da-4bd4-856d-9ea22cb8ed1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:21.730890 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d7305087-f8da-4bd4-856d-9ea22cb8ed1d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.162271 Jun 28 12:05:21.731489 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 84/148] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:21 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:21.794451 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f2529af3-c68d-4191-b55b-4570958db6e7 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:21.802041 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f2529af3-c68d-4191-b55b-4570958db6e7 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.157740 Jun 28 12:05:21.802614 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 65/149] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:21 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:22.574645 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5958d1c7-bc37-4bb7-8839-030e69117a0d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:22.575421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5958d1c7-bc37-4bb7-8839-030e69117a0d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:22.583889 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5958d1c7-bc37-4bb7-8839-030e69117a0d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:22.584494 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5958d1c7-bc37-4bb7-8839-030e69117a0d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:22.585475 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5958d1c7-bc37-4bb7-8839-030e69117a0d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:22.585906 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5958d1c7-bc37-4bb7-8839-030e69117a0d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:22.664094 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-54559aed-02f7-4c81-920d-be89102f0e71 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:22.665545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-54559aed-02f7-4c81-920d-be89102f0e71 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:22.674141 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54559aed-02f7-4c81-920d-be89102f0e71 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:22.674579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54559aed-02f7-4c81-920d-be89102f0e71 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:22.675324 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54559aed-02f7-4c81-920d-be89102f0e71 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:22.675733 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54559aed-02f7-4c81-920d-be89102f0e71 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:22.727155 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5958d1c7-bc37-4bb7-8839-030e69117a0d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:22.735362 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5958d1c7-bc37-4bb7-8839-030e69117a0d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:22.736873 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5958d1c7-bc37-4bb7-8839-030e69117a0d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:22.738025 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5958d1c7-bc37-4bb7-8839-030e69117a0d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.168889 Jun 28 12:05:22.738547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 85/150] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:22 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:22.747333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-697e6b6a-1654-4372-93a7-fa431a660bfa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:22.747993 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-697e6b6a-1654-4372-93a7-fa431a660bfa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:22.754124 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-697e6b6a-1654-4372-93a7-fa431a660bfa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:22.754631 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-697e6b6a-1654-4372-93a7-fa431a660bfa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:22.755303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-697e6b6a-1654-4372-93a7-fa431a660bfa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:22.755733 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-697e6b6a-1654-4372-93a7-fa431a660bfa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:22.811207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-54559aed-02f7-4c81-920d-be89102f0e71 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:22.820836 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-54559aed-02f7-4c81-920d-be89102f0e71 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.160445 Jun 28 12:05:22.821485 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 66/151] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:22 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:22.826033 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9ee3af9b-ba22-4d3e-95e3-b03bf5676f24 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:22.826658 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9ee3af9b-ba22-4d3e-95e3-b03bf5676f24 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:22.832679 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ee3af9b-ba22-4d3e-95e3-b03bf5676f24 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:22.833173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ee3af9b-ba22-4d3e-95e3-b03bf5676f24 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:22.833904 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ee3af9b-ba22-4d3e-95e3-b03bf5676f24 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:22.834324 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ee3af9b-ba22-4d3e-95e3-b03bf5676f24 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:22.886113 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-697e6b6a-1654-4372-93a7-fa431a660bfa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:22.894071 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-697e6b6a-1654-4372-93a7-fa431a660bfa tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.150031 Jun 28 12:05:22.894649 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 86/152] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:22 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:22.964349 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9ee3af9b-ba22-4d3e-95e3-b03bf5676f24 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:22.972325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9ee3af9b-ba22-4d3e-95e3-b03bf5676f24 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.149696 Jun 28 12:05:22.972895 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 67/153] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:22 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:23.755823 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4ea57ade-9652-4405-b239-f628c44680d1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:23.756429 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4ea57ade-9652-4405-b239-f628c44680d1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:23.763531 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4ea57ade-9652-4405-b239-f628c44680d1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:23.764003 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4ea57ade-9652-4405-b239-f628c44680d1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:23.764739 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4ea57ade-9652-4405-b239-f628c44680d1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:23.765198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4ea57ade-9652-4405-b239-f628c44680d1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:23.839134 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f6829464-8769-454d-b448-b03cf42ee1d7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:23.839696 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f6829464-8769-454d-b448-b03cf42ee1d7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:23.846553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6829464-8769-454d-b448-b03cf42ee1d7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:23.847031 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6829464-8769-454d-b448-b03cf42ee1d7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:23.847835 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6829464-8769-454d-b448-b03cf42ee1d7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:23.848245 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6829464-8769-454d-b448-b03cf42ee1d7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:23.902023 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4ea57ade-9652-4405-b239-f628c44680d1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:23.910170 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4ea57ade-9652-4405-b239-f628c44680d1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:23.911681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4ea57ade-9652-4405-b239-f628c44680d1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:23.912786 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4ea57ade-9652-4405-b239-f628c44680d1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.160928 Jun 28 12:05:23.914016 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 87/154] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:23 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:23.918584 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e7aed262-2ae2-4983-b6c2-db7ba92204e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:23.919181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e7aed262-2ae2-4983-b6c2-db7ba92204e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:23.925074 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7aed262-2ae2-4983-b6c2-db7ba92204e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:23.925510 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7aed262-2ae2-4983-b6c2-db7ba92204e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:23.926323 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7aed262-2ae2-4983-b6c2-db7ba92204e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:23.926658 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7aed262-2ae2-4983-b6c2-db7ba92204e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:23.979104 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6829464-8769-454d-b448-b03cf42ee1d7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:23.982727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:23.987359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f6829464-8769-454d-b448-b03cf42ee1d7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.152584 Jun 28 12:05:23.987911 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 68/155] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:23 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:23.992940 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-50d1b376-52a3-42df-ad00-f787d621d1ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:23.993581 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-50d1b376-52a3-42df-ad00-f787d621d1ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:23.999933 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50d1b376-52a3-42df-ad00-f787d621d1ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:24.000389 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50d1b376-52a3-42df-ad00-f787d621d1ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:24.001181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50d1b376-52a3-42df-ad00-f787d621d1ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:24.001628 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50d1b376-52a3-42df-ad00-f787d621d1ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:24.056539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e7aed262-2ae2-4983-b6c2-db7ba92204e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:24.064503 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e7aed262-2ae2-4983-b6c2-db7ba92204e9 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.149382 Jun 28 12:05:24.065106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 88/156] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:23 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:24.137159 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-50d1b376-52a3-42df-ad00-f787d621d1ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:24.144821 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-50d1b376-52a3-42df-ad00-f787d621d1ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.155951 Jun 28 12:05:24.145431 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 69/157] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:23 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:24.936206 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-54051a3c-680e-44f9-983d-b576389b9017 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:24.937054 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-54051a3c-680e-44f9-983d-b576389b9017 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:24.947777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-54051a3c-680e-44f9-983d-b576389b9017 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:24.948525 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-54051a3c-680e-44f9-983d-b576389b9017 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:24.949833 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-54051a3c-680e-44f9-983d-b576389b9017 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:24.950553 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-54051a3c-680e-44f9-983d-b576389b9017 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:25.004351 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dd8ab4f6-5c56-4fdd-95ee-c87e1ce122ac tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:25.005099 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dd8ab4f6-5c56-4fdd-95ee-c87e1ce122ac tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:25.012102 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd8ab4f6-5c56-4fdd-95ee-c87e1ce122ac tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:25.012559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd8ab4f6-5c56-4fdd-95ee-c87e1ce122ac tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:25.013398 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd8ab4f6-5c56-4fdd-95ee-c87e1ce122ac tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:25.013834 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dd8ab4f6-5c56-4fdd-95ee-c87e1ce122ac tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:25.101436 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-54051a3c-680e-44f9-983d-b576389b9017 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:25.112859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-54051a3c-680e-44f9-983d-b576389b9017 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:25.115224 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-54051a3c-680e-44f9-983d-b576389b9017 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:25.116659 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-54051a3c-680e-44f9-983d-b576389b9017 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.187358 Jun 28 12:05:25.117570 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 89/158] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:24 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:25.122591 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3998083d-b510-4c84-9ebe-d44eb266c347 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:25.123196 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3998083d-b510-4c84-9ebe-d44eb266c347 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:25.129542 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3998083d-b510-4c84-9ebe-d44eb266c347 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:25.130171 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3998083d-b510-4c84-9ebe-d44eb266c347 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:25.131106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3998083d-b510-4c84-9ebe-d44eb266c347 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:25.132038 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3998083d-b510-4c84-9ebe-d44eb266c347 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:25.156146 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dd8ab4f6-5c56-4fdd-95ee-c87e1ce122ac tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:25.164289 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dd8ab4f6-5c56-4fdd-95ee-c87e1ce122ac tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.163715 Jun 28 12:05:25.165185 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 70/159] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:24 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:25.169817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1d5335c1-b27d-48e1-bad3-a6262459258b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:25.170565 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1d5335c1-b27d-48e1-bad3-a6262459258b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:25.176711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d5335c1-b27d-48e1-bad3-a6262459258b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:25.177181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d5335c1-b27d-48e1-bad3-a6262459258b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:25.178065 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d5335c1-b27d-48e1-bad3-a6262459258b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:25.178786 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d5335c1-b27d-48e1-bad3-a6262459258b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:25.275189 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3998083d-b510-4c84-9ebe-d44eb266c347 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:25.283837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3998083d-b510-4c84-9ebe-d44eb266c347 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.164871 Jun 28 12:05:25.284532 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 90/160] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:25 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:25.321558 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1d5335c1-b27d-48e1-bad3-a6262459258b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:25.334973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1d5335c1-b27d-48e1-bad3-a6262459258b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.168613 Jun 28 12:05:25.336688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 71/161] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:25 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:26.136795 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7772414a-dce6-4158-8f26-bdd86acf6c60 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:26.137424 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7772414a-dce6-4158-8f26-bdd86acf6c60 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:26.144232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7772414a-dce6-4158-8f26-bdd86acf6c60 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:26.144686 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7772414a-dce6-4158-8f26-bdd86acf6c60 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:26.145474 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7772414a-dce6-4158-8f26-bdd86acf6c60 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:26.145905 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7772414a-dce6-4158-8f26-bdd86acf6c60 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:26.181198 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e2f950ab-4e96-4ea2-96f6-548d61d95413 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:26.181806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e2f950ab-4e96-4ea2-96f6-548d61d95413 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:26.188126 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2f950ab-4e96-4ea2-96f6-548d61d95413 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:26.188773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2f950ab-4e96-4ea2-96f6-548d61d95413 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:26.189681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2f950ab-4e96-4ea2-96f6-548d61d95413 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:26.190208 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2f950ab-4e96-4ea2-96f6-548d61d95413 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:26.303993 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7772414a-dce6-4158-8f26-bdd86acf6c60 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:26.319377 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7772414a-dce6-4158-8f26-bdd86acf6c60 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:26.322215 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7772414a-dce6-4158-8f26-bdd86acf6c60 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:26.323547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7772414a-dce6-4158-8f26-bdd86acf6c60 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.191458 Jun 28 12:05:26.324252 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 91/162] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:26 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:26.329911 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3b96f543-55cb-42ad-9cb7-9b9e7fbe5f26 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:26.331182 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3b96f543-55cb-42ad-9cb7-9b9e7fbe5f26 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:26.338693 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b96f543-55cb-42ad-9cb7-9b9e7fbe5f26 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:26.339137 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b96f543-55cb-42ad-9cb7-9b9e7fbe5f26 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:26.339902 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b96f543-55cb-42ad-9cb7-9b9e7fbe5f26 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:26.340327 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3b96f543-55cb-42ad-9cb7-9b9e7fbe5f26 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:26.364367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e2f950ab-4e96-4ea2-96f6-548d61d95413 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:26.373113 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e2f950ab-4e96-4ea2-96f6-548d61d95413 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.195639 Jun 28 12:05:26.374176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 72/163] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:26 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:26.380784 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a727f083-b41b-4a7f-98d7-e458d69796cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:26.381941 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a727f083-b41b-4a7f-98d7-e458d69796cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:26.384182 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:26.390482 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a727f083-b41b-4a7f-98d7-e458d69796cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:26.391324 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a727f083-b41b-4a7f-98d7-e458d69796cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:26.392212 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a727f083-b41b-4a7f-98d7-e458d69796cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:26.392714 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a727f083-b41b-4a7f-98d7-e458d69796cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:26.527783 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3b96f543-55cb-42ad-9cb7-9b9e7fbe5f26 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:26.535357 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3b96f543-55cb-42ad-9cb7-9b9e7fbe5f26 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.209805 Jun 28 12:05:26.536138 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 92/164] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:26 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:26.558603 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a727f083-b41b-4a7f-98d7-e458d69796cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:26.566324 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a727f083-b41b-4a7f-98d7-e458d69796cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.191008 Jun 28 12:05:26.567053 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 73/165] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:26 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:26.939963 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-a2eebba3-d592-4607-8d27-f52a1ef19aba req-e7820e80-0669-4572-bb01-5a5a8b67b58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350964d7-7d2a-4335-b45e-c50e8cd87f7d", "name": "network-vif-plugged", "status": "completed", "tag": "5f8ebf1b-007a-4caf-9a83-c43616b46917"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:26.953115 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a2eebba3-d592-4607-8d27-f52a1ef19aba req-e7820e80-0669-4572-bb01-5a5a8b67b58f service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:26.953635 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a2eebba3-d592-4607-8d27-f52a1ef19aba req-e7820e80-0669-4572-bb01-5a5a8b67b58f service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:26.976738 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-a2eebba3-d592-4607-8d27-f52a1ef19aba req-e7820e80-0669-4572-bb01-5a5a8b67b58f service nova] Creating event network-vif-plugged:5f8ebf1b-007a-4caf-9a83-c43616b46917 for instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d on hv-cinder-84795 Jun 28 12:05:26.984252 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-a2eebba3-d592-4607-8d27-f52a1ef19aba req-e7820e80-0669-4572-bb01-5a5a8b67b58f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049196 Jun 28 12:05:26.986172 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 93/166] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:05:27.342607 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6f4ca142-f220-4962-9299-bea4d9359dbd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:27.343306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6f4ca142-f220-4962-9299-bea4d9359dbd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:27.350609 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f4ca142-f220-4962-9299-bea4d9359dbd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:27.351347 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f4ca142-f220-4962-9299-bea4d9359dbd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:27.352310 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f4ca142-f220-4962-9299-bea4d9359dbd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:27.352842 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f4ca142-f220-4962-9299-bea4d9359dbd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:27.392292 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-43b6bdf7-2c32-417e-beea-7f3260185db6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:27.392998 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-43b6bdf7-2c32-417e-beea-7f3260185db6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:27.401228 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43b6bdf7-2c32-417e-beea-7f3260185db6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:27.401678 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43b6bdf7-2c32-417e-beea-7f3260185db6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:27.402441 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43b6bdf7-2c32-417e-beea-7f3260185db6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:27.402862 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-43b6bdf7-2c32-417e-beea-7f3260185db6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:27.536973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6f4ca142-f220-4962-9299-bea4d9359dbd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:27.556255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6f4ca142-f220-4962-9299-bea4d9359dbd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:27.557327 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6f4ca142-f220-4962-9299-bea4d9359dbd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:27.560371 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6f4ca142-f220-4962-9299-bea4d9359dbd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.222313 Jun 28 12:05:27.563000 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 74/167] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:27 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:27.570130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-72e8f0a6-d3fa-49c6-b237-5f753a3315c7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:27.570742 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-72e8f0a6-d3fa-49c6-b237-5f753a3315c7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:27.577219 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72e8f0a6-d3fa-49c6-b237-5f753a3315c7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:27.577661 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72e8f0a6-d3fa-49c6-b237-5f753a3315c7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:27.578675 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72e8f0a6-d3fa-49c6-b237-5f753a3315c7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:27.579109 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72e8f0a6-d3fa-49c6-b237-5f753a3315c7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:27.698565 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-43b6bdf7-2c32-417e-beea-7f3260185db6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:27.706869 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-43b6bdf7-2c32-417e-beea-7f3260185db6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.318634 Jun 28 12:05:27.709147 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 94/168] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:27 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:27.714152 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-90b8fa10-be34-4ee4-a740-eacd86e87f79 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:27.723320 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-90b8fa10-be34-4ee4-a740-eacd86e87f79 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:27.732125 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90b8fa10-be34-4ee4-a740-eacd86e87f79 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:27.732574 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90b8fa10-be34-4ee4-a740-eacd86e87f79 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:27.733377 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90b8fa10-be34-4ee4-a740-eacd86e87f79 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:27.736533 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90b8fa10-be34-4ee4-a740-eacd86e87f79 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:27.965872 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-90b8fa10-be34-4ee4-a740-eacd86e87f79 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:27.970653 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-72e8f0a6-d3fa-49c6-b237-5f753a3315c7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:27.974757 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-90b8fa10-be34-4ee4-a740-eacd86e87f79 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.263943 Jun 28 12:05:27.975864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 95/169] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:27 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:27.983822 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-72e8f0a6-d3fa-49c6-b237-5f753a3315c7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.419746 Jun 28 12:05:27.985264 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 75/170] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:27 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:28.578609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-915843b0-231c-447a-af8b-4e86aaee706c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:28.579220 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-915843b0-231c-447a-af8b-4e86aaee706c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:28.585471 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-915843b0-231c-447a-af8b-4e86aaee706c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:28.586103 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-915843b0-231c-447a-af8b-4e86aaee706c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:28.587029 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-915843b0-231c-447a-af8b-4e86aaee706c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:28.587714 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-915843b0-231c-447a-af8b-4e86aaee706c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:28.725796 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a0574d79-e22c-428c-9963-d07a45a728cb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:28.732581 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a0574d79-e22c-428c-9963-d07a45a728cb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:28.740325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0574d79-e22c-428c-9963-d07a45a728cb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:28.740992 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0574d79-e22c-428c-9963-d07a45a728cb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:28.742385 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0574d79-e22c-428c-9963-d07a45a728cb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:28.743219 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a0574d79-e22c-428c-9963-d07a45a728cb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:28.745800 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-915843b0-231c-447a-af8b-4e86aaee706c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:28.759313 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-915843b0-231c-447a-af8b-4e86aaee706c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:28.761817 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-915843b0-231c-447a-af8b-4e86aaee706c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:28.763435 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-915843b0-231c-447a-af8b-4e86aaee706c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.188833 Jun 28 12:05:28.773506 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 96/171] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:28 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:28.894320 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a0574d79-e22c-428c-9963-d07a45a728cb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:28.905074 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a0574d79-e22c-428c-9963-d07a45a728cb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.182296 Jun 28 12:05:28.906161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 76/172] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:28 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:28.992353 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-dacada82-318a-4e1a-8892-2a1cb414fdca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:28.993394 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-dacada82-318a-4e1a-8892-2a1cb414fdca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:29.001979 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-594ec125-0aa4-4b7b-853a-bc74c3b1fd39 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:29.002865 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-594ec125-0aa4-4b7b-853a-bc74c3b1fd39 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:29.023911 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dacada82-318a-4e1a-8892-2a1cb414fdca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:29.025290 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-594ec125-0aa4-4b7b-853a-bc74c3b1fd39 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:29.025781 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-594ec125-0aa4-4b7b-853a-bc74c3b1fd39 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:29.031186 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dacada82-318a-4e1a-8892-2a1cb414fdca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:29.032928 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-594ec125-0aa4-4b7b-853a-bc74c3b1fd39 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:29.033415 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-594ec125-0aa4-4b7b-853a-bc74c3b1fd39 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:29.035391 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dacada82-318a-4e1a-8892-2a1cb414fdca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:29.035837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dacada82-318a-4e1a-8892-2a1cb414fdca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:29.359071 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-594ec125-0aa4-4b7b-853a-bc74c3b1fd39 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:29.376064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-594ec125-0aa4-4b7b-853a-bc74c3b1fd39 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1314 microversion: 2.1 time: 0.377713 Jun 28 12:05:29.377347 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 77/173] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:28 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:29.390367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-9e64ba26-1c8e-413f-9c9f-ff331ec9ee37 req-fde35646-4a9e-4c53-b359-40f4ecb82ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8e28f3-fac6-4e0d-87c5-2480dd846898", "name": "network-vif-plugged", "status": "completed", "tag": "689820bb-e174-4537-8fa7-10a586085c72"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:29.408427 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9e64ba26-1c8e-413f-9c9f-ff331ec9ee37 req-fde35646-4a9e-4c53-b359-40f4ecb82ff8 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:29.409207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9e64ba26-1c8e-413f-9c9f-ff331ec9ee37 req-fde35646-4a9e-4c53-b359-40f4ecb82ff8 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:29.431569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-9e64ba26-1c8e-413f-9c9f-ff331ec9ee37 req-fde35646-4a9e-4c53-b359-40f4ecb82ff8 service nova] Creating event network-vif-plugged:689820bb-e174-4537-8fa7-10a586085c72 for instance 0e8e28f3-fac6-4e0d-87c5-2480dd846898 on hv-cinder-84795 Jun 28 12:05:29.440933 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-9e64ba26-1c8e-413f-9c9f-ff331ec9ee37 req-fde35646-4a9e-4c53-b359-40f4ecb82ff8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061186 Jun 28 12:05:29.442908 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 78/174] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:05:29.696547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dacada82-318a-4e1a-8892-2a1cb414fdca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:29.704612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-dacada82-318a-4e1a-8892-2a1cb414fdca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.716635 Jun 28 12:05:29.709561 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 97/175] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:28 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:29.784411 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-663270d8-2fb8-4767-b653-fddbb003795d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:29.786595 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-663270d8-2fb8-4767-b653-fddbb003795d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:29.796564 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-663270d8-2fb8-4767-b653-fddbb003795d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:29.797379 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-663270d8-2fb8-4767-b653-fddbb003795d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:29.798367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-663270d8-2fb8-4767-b653-fddbb003795d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:29.799004 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-663270d8-2fb8-4767-b653-fddbb003795d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:29.922619 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5cb8613b-18f9-4775-88a8-9726a1c8a18d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:29.923875 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5cb8613b-18f9-4775-88a8-9726a1c8a18d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:29.933153 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5cb8613b-18f9-4775-88a8-9726a1c8a18d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:29.933996 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5cb8613b-18f9-4775-88a8-9726a1c8a18d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:29.935171 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5cb8613b-18f9-4775-88a8-9726a1c8a18d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:29.942263 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5cb8613b-18f9-4775-88a8-9726a1c8a18d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:30.165463 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-663270d8-2fb8-4767-b653-fddbb003795d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:30.175981 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-663270d8-2fb8-4767-b653-fddbb003795d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:30.178403 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-663270d8-2fb8-4767-b653-fddbb003795d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:30.179706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-663270d8-2fb8-4767-b653-fddbb003795d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.400467 Jun 28 12:05:30.180820 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 79/176] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:29 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:30.202883 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5cb8613b-18f9-4775-88a8-9726a1c8a18d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:30.211903 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5cb8613b-18f9-4775-88a8-9726a1c8a18d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.293611 Jun 28 12:05:30.212647 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 98/177] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:29 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:30.393232 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-076c8fa4-59d9-4124-b5cc-0ed0b47c6f76 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:30.393910 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-076c8fa4-59d9-4124-b5cc-0ed0b47c6f76 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:30.400772 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-076c8fa4-59d9-4124-b5cc-0ed0b47c6f76 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:30.401246 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-076c8fa4-59d9-4124-b5cc-0ed0b47c6f76 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:30.402009 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-076c8fa4-59d9-4124-b5cc-0ed0b47c6f76 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:30.402435 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-076c8fa4-59d9-4124-b5cc-0ed0b47c6f76 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:30.559474 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-076c8fa4-59d9-4124-b5cc-0ed0b47c6f76 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:30.568189 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-076c8fa4-59d9-4124-b5cc-0ed0b47c6f76 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1502 microversion: 2.1 time: 0.178642 Jun 28 12:05:30.568761 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 80/178] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:30 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:30.721702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f35cba14-6fd9-406a-b7d0-66f6199aba86 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:30.722493 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f35cba14-6fd9-406a-b7d0-66f6199aba86 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:30.728889 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f35cba14-6fd9-406a-b7d0-66f6199aba86 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:30.729555 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f35cba14-6fd9-406a-b7d0-66f6199aba86 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:30.730516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f35cba14-6fd9-406a-b7d0-66f6199aba86 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:30.731098 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f35cba14-6fd9-406a-b7d0-66f6199aba86 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:31.063666 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f35cba14-6fd9-406a-b7d0-66f6199aba86 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:31.077697 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f35cba14-6fd9-406a-b7d0-66f6199aba86 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.359865 Jun 28 12:05:31.078421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 99/179] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:30 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:31.199516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c4af6851-57f0-42e9-95fb-99304d4678a8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:31.200129 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c4af6851-57f0-42e9-95fb-99304d4678a8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:31.212104 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4af6851-57f0-42e9-95fb-99304d4678a8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:31.213721 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4af6851-57f0-42e9-95fb-99304d4678a8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:31.217256 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4af6851-57f0-42e9-95fb-99304d4678a8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:31.217834 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4af6851-57f0-42e9-95fb-99304d4678a8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:31.229993 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3f88b9b8-1d61-403d-972f-a3ae1562e0e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:31.230880 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3f88b9b8-1d61-403d-972f-a3ae1562e0e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:31.238475 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f88b9b8-1d61-403d-972f-a3ae1562e0e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:31.239563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f88b9b8-1d61-403d-972f-a3ae1562e0e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:31.241110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f88b9b8-1d61-403d-972f-a3ae1562e0e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:31.242175 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3f88b9b8-1d61-403d-972f-a3ae1562e0e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:31.274057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:31.418500 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3f88b9b8-1d61-403d-972f-a3ae1562e0e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:31.432670 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3f88b9b8-1d61-403d-972f-a3ae1562e0e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.207596 Jun 28 12:05:31.434107 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 100/180] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:31 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:31.435947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4af6851-57f0-42e9-95fb-99304d4678a8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:31.446117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4af6851-57f0-42e9-95fb-99304d4678a8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:31.447632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4af6851-57f0-42e9-95fb-99304d4678a8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:31.448754 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c4af6851-57f0-42e9-95fb-99304d4678a8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.253397 Jun 28 12:05:31.449701 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 81/181] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:31 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:32.101640 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-46107563-71dc-4f8b-b17c-13ebb26e120f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:32.102501 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-46107563-71dc-4f8b-b17c-13ebb26e120f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:32.111619 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-46107563-71dc-4f8b-b17c-13ebb26e120f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:32.118577 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-46107563-71dc-4f8b-b17c-13ebb26e120f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:32.119481 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-46107563-71dc-4f8b-b17c-13ebb26e120f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:32.119926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-46107563-71dc-4f8b-b17c-13ebb26e120f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:32.219035 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-739da08b-882d-4388-87d0-1f12d7d14243 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37b6ad76-f116-4c4c-937d-f1fcc884b79c"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:32.221105 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-739da08b-882d-4388-87d0-1f12d7d14243 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:32.228678 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-739da08b-882d-4388-87d0-1f12d7d14243 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:32.229118 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-739da08b-882d-4388-87d0-1f12d7d14243 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:32.230096 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-739da08b-882d-4388-87d0-1f12d7d14243 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:32.230728 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-739da08b-882d-4388-87d0-1f12d7d14243 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:32.300141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-46107563-71dc-4f8b-b17c-13ebb26e120f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:32.308781 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-46107563-71dc-4f8b-b17c-13ebb26e120f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.211133 Jun 28 12:05:32.318261 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 101/182] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:32 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:32.452249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-12c06121-beb6-4afc-97f2-44284dbc8972 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:32.452860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-12c06121-beb6-4afc-97f2-44284dbc8972 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:32.462318 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-12c06121-beb6-4afc-97f2-44284dbc8972 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:32.463183 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-12c06121-beb6-4afc-97f2-44284dbc8972 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:32.464342 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-12c06121-beb6-4afc-97f2-44284dbc8972 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:32.465032 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-12c06121-beb6-4afc-97f2-44284dbc8972 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:32.658871 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-12c06121-beb6-4afc-97f2-44284dbc8972 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:32.672848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-12c06121-beb6-4afc-97f2-44284dbc8972 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.221649 Jun 28 12:05:32.674854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 102/183] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:32 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:32.693600 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-85482509-0d1f-466a-8bc1-5a47c7aa04e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:32.694883 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-85482509-0d1f-466a-8bc1-5a47c7aa04e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:32.704890 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-85482509-0d1f-466a-8bc1-5a47c7aa04e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:32.705618 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-85482509-0d1f-466a-8bc1-5a47c7aa04e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:32.706755 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-85482509-0d1f-466a-8bc1-5a47c7aa04e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:32.707818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-85482509-0d1f-466a-8bc1-5a47c7aa04e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:32.887119 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-85482509-0d1f-466a-8bc1-5a47c7aa04e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:32.895851 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-85482509-0d1f-466a-8bc1-5a47c7aa04e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:32.898516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-85482509-0d1f-466a-8bc1-5a47c7aa04e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:32.900167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-85482509-0d1f-466a-8bc1-5a47c7aa04e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1407 microversion: 2.20 time: 0.211918 Jun 28 12:05:32.901263 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 103/184] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:32 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:33.340827 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2925a900-f013-4eb2-b249-901c2b57d105 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:33.343788 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2925a900-f013-4eb2-b249-901c2b57d105 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:33.351717 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2925a900-f013-4eb2-b249-901c2b57d105 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:33.355924 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2925a900-f013-4eb2-b249-901c2b57d105 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:33.358325 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2925a900-f013-4eb2-b249-901c2b57d105 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:33.359490 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2925a900-f013-4eb2-b249-901c2b57d105 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:33.527883 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2925a900-f013-4eb2-b249-901c2b57d105 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:33.537109 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2925a900-f013-4eb2-b249-901c2b57d105 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.205185 Jun 28 12:05:33.546566 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 104/185] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:33 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:33.693181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b6a8b1c2-7e56-4761-b9dc-852364148a0c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:33.699411 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b6a8b1c2-7e56-4761-b9dc-852364148a0c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:33.715100 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6a8b1c2-7e56-4761-b9dc-852364148a0c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:33.715959 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6a8b1c2-7e56-4761-b9dc-852364148a0c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:33.717533 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6a8b1c2-7e56-4761-b9dc-852364148a0c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:33.718122 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6a8b1c2-7e56-4761-b9dc-852364148a0c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:33.917987 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b6a8b1c2-7e56-4761-b9dc-852364148a0c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:33.925559 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b6a8b1c2-7e56-4761-b9dc-852364148a0c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.237798 Jun 28 12:05:33.935956 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 105/186] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:33 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:33.944636 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4b04172c-678b-49be-8a39-95d8f1bdde5b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:33.945275 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4b04172c-678b-49be-8a39-95d8f1bdde5b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:33.952022 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4b04172c-678b-49be-8a39-95d8f1bdde5b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:33.952411 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4b04172c-678b-49be-8a39-95d8f1bdde5b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:33.953585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4b04172c-678b-49be-8a39-95d8f1bdde5b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:33.954266 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4b04172c-678b-49be-8a39-95d8f1bdde5b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:34.111536 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4b04172c-678b-49be-8a39-95d8f1bdde5b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:34.120442 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4b04172c-678b-49be-8a39-95d8f1bdde5b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:34.121961 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4b04172c-678b-49be-8a39-95d8f1bdde5b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:34.123193 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4b04172c-678b-49be-8a39-95d8f1bdde5b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1599 microversion: 2.20 time: 0.185992 Jun 28 12:05:34.130157 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 106/187] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:05:33 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1599 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:05:34.142926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4086cf00-9695-430b-8d4d-c1062362aa59 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:34.143894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4086cf00-9695-430b-8d4d-c1062362aa59 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:34.150889 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4086cf00-9695-430b-8d4d-c1062362aa59 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:34.151330 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4086cf00-9695-430b-8d4d-c1062362aa59 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:34.152098 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4086cf00-9695-430b-8d4d-c1062362aa59 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:34.152526 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4086cf00-9695-430b-8d4d-c1062362aa59 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:34.305724 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4086cf00-9695-430b-8d4d-c1062362aa59 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.167418 Jun 28 12:05:34.306583 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 107/188] 10.222.0.55 () {60 vars in 1315 bytes} [Tue Jun 28 12:05:34 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 28 12:05:34.524374 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-739da08b-882d-4388-87d0-1f12d7d14243 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "POST /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.309330 Jun 28 12:05:34.526319 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 82/189] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:05:32 2022] POST /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759/os-volume_attachments => generated 194 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:05:34.554364 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2c0d25ee-f74b-43fc-a723-a366eedefc7e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:34.555080 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2c0d25ee-f74b-43fc-a723-a366eedefc7e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:34.562688 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c0d25ee-f74b-43fc-a723-a366eedefc7e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:34.562953 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c0d25ee-f74b-43fc-a723-a366eedefc7e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:34.567877 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c0d25ee-f74b-43fc-a723-a366eedefc7e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:34.568374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c0d25ee-f74b-43fc-a723-a366eedefc7e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:34.872161 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2c0d25ee-f74b-43fc-a723-a366eedefc7e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:34.886394 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2c0d25ee-f74b-43fc-a723-a366eedefc7e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.336021 Jun 28 12:05:34.887509 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 108/190] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:34 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:34.951624 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7c59bc5a-5260-45d4-b21a-ece2eed33511 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:34.952735 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7c59bc5a-5260-45d4-b21a-ece2eed33511 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:34.962246 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c59bc5a-5260-45d4-b21a-ece2eed33511 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:34.963212 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c59bc5a-5260-45d4-b21a-ece2eed33511 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:34.964274 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c59bc5a-5260-45d4-b21a-ece2eed33511 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:34.964998 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c59bc5a-5260-45d4-b21a-ece2eed33511 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:35.210711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7c59bc5a-5260-45d4-b21a-ece2eed33511 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:35.226234 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7c59bc5a-5260-45d4-b21a-ece2eed33511 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1321 microversion: 2.1 time: 0.280241 Jun 28 12:05:35.228186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 83/191] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:34 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:35.904064 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-98a9883a-3b42-4081-9142-316bcb0027cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:35.904787 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-98a9883a-3b42-4081-9142-316bcb0027cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:35.918453 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98a9883a-3b42-4081-9142-316bcb0027cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:35.918973 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98a9883a-3b42-4081-9142-316bcb0027cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:35.919809 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98a9883a-3b42-4081-9142-316bcb0027cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:35.920321 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98a9883a-3b42-4081-9142-316bcb0027cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:36.244501 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dbea366a-e887-47a0-b93c-ab24396afeaf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:36.256186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dbea366a-e887-47a0-b93c-ab24396afeaf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:36.271464 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbea366a-e887-47a0-b93c-ab24396afeaf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:36.272747 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbea366a-e887-47a0-b93c-ab24396afeaf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:36.273800 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbea366a-e887-47a0-b93c-ab24396afeaf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:36.275572 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbea366a-e887-47a0-b93c-ab24396afeaf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:36.316858 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-98a9883a-3b42-4081-9142-316bcb0027cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:36.330948 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-98a9883a-3b42-4081-9142-316bcb0027cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.430788 Jun 28 12:05:36.333798 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 109/192] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:35 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:36.348451 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-738eca13-0750-4cd9-96e2-2df7ef457d22 req-e2a857fa-1d6d-4abd-bc4e-19e1b09070d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "350964d7-7d2a-4335-b45e-c50e8cd87f7d", "tag": "5f8ebf1b-007a-4caf-9a83-c43616b46917"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:36.377975 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-738eca13-0750-4cd9-96e2-2df7ef457d22 req-e2a857fa-1d6d-4abd-bc4e-19e1b09070d8 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:36.378478 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-738eca13-0750-4cd9-96e2-2df7ef457d22 req-e2a857fa-1d6d-4abd-bc4e-19e1b09070d8 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:36.405240 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-738eca13-0750-4cd9-96e2-2df7ef457d22 req-e2a857fa-1d6d-4abd-bc4e-19e1b09070d8 service nova] Creating event network-changed:5f8ebf1b-007a-4caf-9a83-c43616b46917 for instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d on hv-cinder-84795 Jun 28 12:05:36.415362 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-738eca13-0750-4cd9-96e2-2df7ef457d22 req-e2a857fa-1d6d-4abd-bc4e-19e1b09070d8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074621 Jun 28 12:05:36.421635 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 110/193] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:05:36.645434 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dbea366a-e887-47a0-b93c-ab24396afeaf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:36.649923 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:36.656210 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dbea366a-e887-47a0-b93c-ab24396afeaf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1516 microversion: 2.1 time: 0.416149 Jun 28 12:05:36.657737 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 84/194] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:36 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1516 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:36.679342 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4410ac21-921a-449b-8bae-0dc42f775f01 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:36.683857 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4410ac21-921a-449b-8bae-0dc42f775f01 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:36.694313 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4410ac21-921a-449b-8bae-0dc42f775f01 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:36.695069 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4410ac21-921a-449b-8bae-0dc42f775f01 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:36.696799 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4410ac21-921a-449b-8bae-0dc42f775f01 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:36.698399 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4410ac21-921a-449b-8bae-0dc42f775f01 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:36.767867 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-4410ac21-921a-449b-8bae-0dc42f775f01 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lazy-loading 'flavor' on Instance uuid 0e8e28f3-fac6-4e0d-87c5-2480dd846898 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:05:36.904611 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4410ac21-921a-449b-8bae-0dc42f775f01 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "POST /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898/action" status: 200 len: 32 microversion: 2.1 time: 0.232371 Jun 28 12:05:36.906267 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 111/195] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:05:36 2022] POST /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 12:05:36.914527 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-026edc64-8669-45c3-aa59-ebde54347a2b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:36.915150 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-026edc64-8669-45c3-aa59-ebde54347a2b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:36.922210 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-026edc64-8669-45c3-aa59-ebde54347a2b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:36.922662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-026edc64-8669-45c3-aa59-ebde54347a2b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:36.923431 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-026edc64-8669-45c3-aa59-ebde54347a2b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:36.923890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-026edc64-8669-45c3-aa59-ebde54347a2b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:37.287879 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-026edc64-8669-45c3-aa59-ebde54347a2b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:37.309560 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-026edc64-8669-45c3-aa59-ebde54347a2b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.398876 Jun 28 12:05:37.310433 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 85/196] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:36 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:37.351761 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0fcc9a48-db3c-4151-b14a-0426d243c08b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:37.352443 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0fcc9a48-db3c-4151-b14a-0426d243c08b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:37.361638 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0fcc9a48-db3c-4151-b14a-0426d243c08b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:37.363027 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0fcc9a48-db3c-4151-b14a-0426d243c08b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:37.364645 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0fcc9a48-db3c-4151-b14a-0426d243c08b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:37.365551 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0fcc9a48-db3c-4151-b14a-0426d243c08b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:37.588167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0fcc9a48-db3c-4151-b14a-0426d243c08b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:37.597922 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0fcc9a48-db3c-4151-b14a-0426d243c08b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.252717 Jun 28 12:05:37.609707 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 112/197] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:37 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:38.328695 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-021a5de9-1c73-4d86-b21c-75b4173613dc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:38.329246 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-021a5de9-1c73-4d86-b21c-75b4173613dc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:38.338796 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-021a5de9-1c73-4d86-b21c-75b4173613dc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:38.339495 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-021a5de9-1c73-4d86-b21c-75b4173613dc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:38.340678 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-021a5de9-1c73-4d86-b21c-75b4173613dc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:38.341378 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-021a5de9-1c73-4d86-b21c-75b4173613dc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:38.578118 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-021a5de9-1c73-4d86-b21c-75b4173613dc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:38.587502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-021a5de9-1c73-4d86-b21c-75b4173613dc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.261669 Jun 28 12:05:38.587502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 86/198] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:38 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:38.616895 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6d25fd73-aacb-4eba-a69a-f639c0598174 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:38.618372 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6d25fd73-aacb-4eba-a69a-f639c0598174 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:38.625675 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6d25fd73-aacb-4eba-a69a-f639c0598174 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:38.626812 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6d25fd73-aacb-4eba-a69a-f639c0598174 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:38.628368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6d25fd73-aacb-4eba-a69a-f639c0598174 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:38.629081 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6d25fd73-aacb-4eba-a69a-f639c0598174 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:38.820685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6d25fd73-aacb-4eba-a69a-f639c0598174 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:38.830346 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6d25fd73-aacb-4eba-a69a-f639c0598174 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.218454 Jun 28 12:05:38.831484 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 113/199] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:38 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:39.616800 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fcfad250-0f87-49ee-af44-5fe2cb34ed0f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:39.618556 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fcfad250-0f87-49ee-af44-5fe2cb34ed0f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:39.626467 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcfad250-0f87-49ee-af44-5fe2cb34ed0f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:39.627010 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcfad250-0f87-49ee-af44-5fe2cb34ed0f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:39.628121 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcfad250-0f87-49ee-af44-5fe2cb34ed0f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:39.628758 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcfad250-0f87-49ee-af44-5fe2cb34ed0f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:39.802880 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fcfad250-0f87-49ee-af44-5fe2cb34ed0f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:39.811249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fcfad250-0f87-49ee-af44-5fe2cb34ed0f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.210216 Jun 28 12:05:39.814983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 87/200] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:39 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:39.847905 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-85ba3ace-b4e6-4544-8c96-d4f6004b2700 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:39.848506 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-85ba3ace-b4e6-4544-8c96-d4f6004b2700 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:39.855476 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-85ba3ace-b4e6-4544-8c96-d4f6004b2700 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:39.855922 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-85ba3ace-b4e6-4544-8c96-d4f6004b2700 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:39.856861 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-85ba3ace-b4e6-4544-8c96-d4f6004b2700 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:39.857502 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-85ba3ace-b4e6-4544-8c96-d4f6004b2700 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:40.047443 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-85ba3ace-b4e6-4544-8c96-d4f6004b2700 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:40.062435 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-85ba3ace-b4e6-4544-8c96-d4f6004b2700 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.214900 Jun 28 12:05:40.063090 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 114/201] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:39 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:40.828787 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8042a3b3-dcbe-42fd-8499-c83a21234d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:40.829724 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8042a3b3-dcbe-42fd-8499-c83a21234d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:40.837606 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8042a3b3-dcbe-42fd-8499-c83a21234d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:40.838047 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8042a3b3-dcbe-42fd-8499-c83a21234d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:40.839089 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8042a3b3-dcbe-42fd-8499-c83a21234d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:40.839614 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8042a3b3-dcbe-42fd-8499-c83a21234d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:41.081031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d08be766-440b-4208-8f3c-abcd9a6fb705 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:41.081647 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d08be766-440b-4208-8f3c-abcd9a6fb705 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:41.092745 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d08be766-440b-4208-8f3c-abcd9a6fb705 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:41.093211 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d08be766-440b-4208-8f3c-abcd9a6fb705 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:41.103338 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d08be766-440b-4208-8f3c-abcd9a6fb705 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:41.103338 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d08be766-440b-4208-8f3c-abcd9a6fb705 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:41.163854 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8042a3b3-dcbe-42fd-8499-c83a21234d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:41.182335 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8042a3b3-dcbe-42fd-8499-c83a21234d05 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.357403 Jun 28 12:05:41.186760 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 88/202] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:40 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:41.546663 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d08be766-440b-4208-8f3c-abcd9a6fb705 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:41.563635 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d08be766-440b-4208-8f3c-abcd9a6fb705 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.487770 Jun 28 12:05:41.564194 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 115/203] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:41 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:42.202048 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f3949f46-958a-4f7e-8c4d-719bc5305174 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:42.203246 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f3949f46-958a-4f7e-8c4d-719bc5305174 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:42.210301 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3949f46-958a-4f7e-8c4d-719bc5305174 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:42.211103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3949f46-958a-4f7e-8c4d-719bc5305174 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:42.212104 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3949f46-958a-4f7e-8c4d-719bc5305174 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:42.212738 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3949f46-958a-4f7e-8c4d-719bc5305174 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:42.391564 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f3949f46-958a-4f7e-8c4d-719bc5305174 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:42.403559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f3949f46-958a-4f7e-8c4d-719bc5305174 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.204530 Jun 28 12:05:42.404464 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 89/204] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:42 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:42.583073 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-36d2377f-adb5-4cb2-906d-6617937e9a12 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:42.585689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-36d2377f-adb5-4cb2-906d-6617937e9a12 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:42.600137 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-36d2377f-adb5-4cb2-906d-6617937e9a12 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:42.601641 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-36d2377f-adb5-4cb2-906d-6617937e9a12 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:42.603017 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-36d2377f-adb5-4cb2-906d-6617937e9a12 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:42.604883 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-36d2377f-adb5-4cb2-906d-6617937e9a12 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:42.610852 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:42.938654 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-36d2377f-adb5-4cb2-906d-6617937e9a12 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:42.949034 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-36d2377f-adb5-4cb2-906d-6617937e9a12 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.371000 Jun 28 12:05:42.963009 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 116/205] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:42 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:43.430184 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c58f865e-59e5-437d-a7fe-49f6a84bb5a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:43.431053 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c58f865e-59e5-437d-a7fe-49f6a84bb5a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:43.443434 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c58f865e-59e5-437d-a7fe-49f6a84bb5a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:43.444327 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c58f865e-59e5-437d-a7fe-49f6a84bb5a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:43.445562 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c58f865e-59e5-437d-a7fe-49f6a84bb5a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:43.446206 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c58f865e-59e5-437d-a7fe-49f6a84bb5a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:43.736872 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c58f865e-59e5-437d-a7fe-49f6a84bb5a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:43.747889 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c58f865e-59e5-437d-a7fe-49f6a84bb5a3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.329366 Jun 28 12:05:43.748648 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 90/206] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:43 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:43.966363 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1d71ead6-7a38-4924-8db6-c1c77961d58e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:43.967362 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1d71ead6-7a38-4924-8db6-c1c77961d58e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:43.976457 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1d71ead6-7a38-4924-8db6-c1c77961d58e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:43.979721 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1d71ead6-7a38-4924-8db6-c1c77961d58e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:43.980589 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1d71ead6-7a38-4924-8db6-c1c77961d58e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:43.981246 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1d71ead6-7a38-4924-8db6-c1c77961d58e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:44.242884 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1d71ead6-7a38-4924-8db6-c1c77961d58e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:44.261010 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1d71ead6-7a38-4924-8db6-c1c77961d58e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.298452 Jun 28 12:05:44.264508 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 117/207] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:43 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:44.767330 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-029efc04-1601-42a3-8554-e696f9051376 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:44.767953 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-029efc04-1601-42a3-8554-e696f9051376 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:44.789899 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-029efc04-1601-42a3-8554-e696f9051376 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:44.790627 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-029efc04-1601-42a3-8554-e696f9051376 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:44.791820 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-029efc04-1601-42a3-8554-e696f9051376 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:44.792405 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-029efc04-1601-42a3-8554-e696f9051376 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:44.999338 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-714f1074-3e07-4431-8aa3-4a14eae4459f req-ab362401-49e6-4d05-8568-03d78b82e3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed81e0c7-a44e-497b-bf2e-cf208dd340de", "name": "network-vif-plugged", "status": "completed", "tag": "66e19dd9-9d9b-4c52-9617-acf66e3f62d9"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:45.019696 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-714f1074-3e07-4431-8aa3-4a14eae4459f req-ab362401-49e6-4d05-8568-03d78b82e3fe service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:45.039368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-714f1074-3e07-4431-8aa3-4a14eae4459f req-ab362401-49e6-4d05-8568-03d78b82e3fe service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:45.095819 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-714f1074-3e07-4431-8aa3-4a14eae4459f req-ab362401-49e6-4d05-8568-03d78b82e3fe service nova] Creating event network-vif-plugged:66e19dd9-9d9b-4c52-9617-acf66e3f62d9 for instance ed81e0c7-a44e-497b-bf2e-cf208dd340de on hv-cinder-84795 Jun 28 12:05:45.115868 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-714f1074-3e07-4431-8aa3-4a14eae4459f req-ab362401-49e6-4d05-8568-03d78b82e3fe service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121222 Jun 28 12:05:45.117973 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 118/208] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:05:45.182592 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-029efc04-1601-42a3-8554-e696f9051376 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:45.205756 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-029efc04-1601-42a3-8554-e696f9051376 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.441666 Jun 28 12:05:45.206404 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 91/209] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:44 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:45.283896 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fc8a342e-27d4-400c-91e8-51fb66d345b5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:45.284701 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fc8a342e-27d4-400c-91e8-51fb66d345b5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:45.313394 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc8a342e-27d4-400c-91e8-51fb66d345b5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:45.313934 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc8a342e-27d4-400c-91e8-51fb66d345b5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:45.315344 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc8a342e-27d4-400c-91e8-51fb66d345b5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:45.315774 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc8a342e-27d4-400c-91e8-51fb66d345b5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:45.842033 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fc8a342e-27d4-400c-91e8-51fb66d345b5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:45.851719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fc8a342e-27d4-400c-91e8-51fb66d345b5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.574754 Jun 28 12:05:45.858879 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 119/210] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:45 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:46.226463 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-54f6ad60-0a87-436b-9106-5c92500d3296 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:46.228829 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-54f6ad60-0a87-436b-9106-5c92500d3296 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:46.243127 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54f6ad60-0a87-436b-9106-5c92500d3296 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:46.244130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54f6ad60-0a87-436b-9106-5c92500d3296 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:46.246820 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54f6ad60-0a87-436b-9106-5c92500d3296 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:46.247684 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54f6ad60-0a87-436b-9106-5c92500d3296 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:46.609889 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-54f6ad60-0a87-436b-9106-5c92500d3296 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:46.624288 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-54f6ad60-0a87-436b-9106-5c92500d3296 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.403425 Jun 28 12:05:46.627447 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 92/211] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:46 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:46.874259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3d1230f6-f424-4c3b-86a4-383134523d53 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:46.875013 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3d1230f6-f424-4c3b-86a4-383134523d53 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:46.885004 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3d1230f6-f424-4c3b-86a4-383134523d53 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:46.888086 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3d1230f6-f424-4c3b-86a4-383134523d53 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:46.889345 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3d1230f6-f424-4c3b-86a4-383134523d53 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:46.889843 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3d1230f6-f424-4c3b-86a4-383134523d53 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:47.351806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3d1230f6-f424-4c3b-86a4-383134523d53 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:47.362175 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3d1230f6-f424-4c3b-86a4-383134523d53 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.491802 Jun 28 12:05:47.363758 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 120/212] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:46 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:47.645248 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-035efed4-35ef-40dd-af70-e3ca68459c99 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:47.645870 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-035efed4-35ef-40dd-af70-e3ca68459c99 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:47.667175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-035efed4-35ef-40dd-af70-e3ca68459c99 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:47.667813 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-035efed4-35ef-40dd-af70-e3ca68459c99 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:47.668761 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-035efed4-35ef-40dd-af70-e3ca68459c99 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:47.669244 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-035efed4-35ef-40dd-af70-e3ca68459c99 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:47.913289 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-035efed4-35ef-40dd-af70-e3ca68459c99 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:47.924490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-035efed4-35ef-40dd-af70-e3ca68459c99 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.284787 Jun 28 12:05:47.933845 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 93/213] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:47 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:48.379792 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b8c985ae-d705-45d8-8de8-50df0321c082 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:48.380943 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b8c985ae-d705-45d8-8de8-50df0321c082 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:48.390605 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8c985ae-d705-45d8-8de8-50df0321c082 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:48.391050 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8c985ae-d705-45d8-8de8-50df0321c082 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:48.391818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8c985ae-d705-45d8-8de8-50df0321c082 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:48.392248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8c985ae-d705-45d8-8de8-50df0321c082 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:48.583869 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b8c985ae-d705-45d8-8de8-50df0321c082 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:48.593675 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b8c985ae-d705-45d8-8de8-50df0321c082 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1362 microversion: 2.1 time: 0.217484 Jun 28 12:05:48.594400 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 121/214] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:48 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:48.773789 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5fd707ee-7ed7-4f7d-9348-51748bba4b8f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Action: 'create', calling method: .version_select at 0x7f393808ca60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1512622342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwaFpBFD1bffrvaBNZCqtiD2zNkNsSP8S43rxcQ0fudS7/69qZipUfQX2VAvdcbVc6acCRU0X4otaP/QgwGGg3ZT0e7UldRz7oxAThJ7TVyXV3LE34vLuRScpM1JkliHQ=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:48.800381 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-5fd707ee-7ed7-4f7d-9348-51748bba4b8f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Getting quotas for project 7235a9c7eff24e0e94900ec2abc92ae5. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:05:48.805269 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-5fd707ee-7ed7-4f7d-9348-51748bba4b8f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Getting quotas for user 9f56095d6bac4f108a73790ac9004f3b and project 7235a9c7eff24e0e94900ec2abc92ae5. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:05:48.850688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5fd707ee-7ed7-4f7d-9348-51748bba4b8f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.371764 Jun 28 12:05:48.851654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 94/215] 10.222.0.55 () {60 vars in 1158 bytes} [Tue Jun 28 12:05:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:05:48.940990 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-92ff4aea-6189-44e4-b636-7daf81460cec tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:48.941753 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-92ff4aea-6189-44e4-b636-7daf81460cec tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:48.956363 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=86 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:48.958197 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-92ff4aea-6189-44e4-b636-7daf81460cec tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:48.959072 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-92ff4aea-6189-44e4-b636-7daf81460cec tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:48.961453 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-92ff4aea-6189-44e4-b636-7daf81460cec tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:48.962446 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-92ff4aea-6189-44e4-b636-7daf81460cec tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:49.243457 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-92ff4aea-6189-44e4-b636-7daf81460cec tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:49.253773 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-92ff4aea-6189-44e4-b636-7daf81460cec tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.316601 Jun 28 12:05:49.255647 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 122/216] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:48 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:49.613485 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c27ad5c6-9037-41b6-a15f-310099c102c3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:49.614290 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c27ad5c6-9037-41b6-a15f-310099c102c3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:49.624333 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c27ad5c6-9037-41b6-a15f-310099c102c3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:49.625061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c27ad5c6-9037-41b6-a15f-310099c102c3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:49.626395 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c27ad5c6-9037-41b6-a15f-310099c102c3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:49.627015 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c27ad5c6-9037-41b6-a15f-310099c102c3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:49.830254 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c27ad5c6-9037-41b6-a15f-310099c102c3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:49.842790 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c27ad5c6-9037-41b6-a15f-310099c102c3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1548 microversion: 2.1 time: 0.234151 Jun 28 12:05:49.843587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 95/217] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:49 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1548 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:49.861338 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6a7ffb19-faf7-4a77-a129-df78849837bd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:49.861893 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6a7ffb19-faf7-4a77-a129-df78849837bd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:49.877031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a7ffb19-faf7-4a77-a129-df78849837bd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:49.878017 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a7ffb19-faf7-4a77-a129-df78849837bd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:49.880124 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a7ffb19-faf7-4a77-a129-df78849837bd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:49.880700 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a7ffb19-faf7-4a77-a129-df78849837bd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:50.088118 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6a7ffb19-faf7-4a77-a129-df78849837bd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230686 Jun 28 12:05:50.089651 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 123/218] 10.222.0.55 () {58 vars in 1274 bytes} [Tue Jun 28 12:05:49 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:05:50.276396 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ac313e72-2162-4b5d-ba07-550d46356003 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:50.276396 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ac313e72-2162-4b5d-ba07-550d46356003 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:50.287585 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac313e72-2162-4b5d-ba07-550d46356003 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:50.288119 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac313e72-2162-4b5d-ba07-550d46356003 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:50.290343 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac313e72-2162-4b5d-ba07-550d46356003 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:50.292054 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac313e72-2162-4b5d-ba07-550d46356003 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:50.583591 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ac313e72-2162-4b5d-ba07-550d46356003 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:50.593830 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ac313e72-2162-4b5d-ba07-550d46356003 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.324547 Jun 28 12:05:50.601255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 96/219] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:50 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:51.383048 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-618ae358-e1af-48d9-9cb9-cebdc283b0a7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:51.383655 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-618ae358-e1af-48d9-9cb9-cebdc283b0a7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:51.395191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-618ae358-e1af-48d9-9cb9-cebdc283b0a7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:51.395635 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-618ae358-e1af-48d9-9cb9-cebdc283b0a7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:51.396424 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-618ae358-e1af-48d9-9cb9-cebdc283b0a7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:51.397163 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-618ae358-e1af-48d9-9cb9-cebdc283b0a7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:51.425971 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-618ae358-e1af-48d9-9cb9-cebdc283b0a7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:05:51.609705 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-618ae358-e1af-48d9-9cb9-cebdc283b0a7 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 204 len: 0 microversion: 2.1 time: 0.230216 Jun 28 12:05:51.612431 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 124/220] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:05:51 2022] DELETE /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:05:51.616125 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-234ef411-b390-4ac4-87b8-e508a7e4fdc6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:51.616707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-234ef411-b390-4ac4-87b8-e508a7e4fdc6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:51.621826 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8385fe24-d412-482f-99bf-97097500788d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:51.622519 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8385fe24-d412-482f-99bf-97097500788d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:51.625481 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-234ef411-b390-4ac4-87b8-e508a7e4fdc6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:51.625934 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-234ef411-b390-4ac4-87b8-e508a7e4fdc6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:51.628629 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-234ef411-b390-4ac4-87b8-e508a7e4fdc6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:51.629109 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-234ef411-b390-4ac4-87b8-e508a7e4fdc6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:51.630550 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8385fe24-d412-482f-99bf-97097500788d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:51.631219 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8385fe24-d412-482f-99bf-97097500788d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:51.632236 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8385fe24-d412-482f-99bf-97097500788d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:51.632816 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8385fe24-d412-482f-99bf-97097500788d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:51.828004 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-234ef411-b390-4ac4-87b8-e508a7e4fdc6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:51.839005 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8385fe24-d412-482f-99bf-97097500788d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:51.845224 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-234ef411-b390-4ac4-87b8-e508a7e4fdc6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.233282 Jun 28 12:05:51.846953 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 97/221] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:51 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:51.854728 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-c3f5476f-f1e2-4eec-a37c-1bd19ecea718 req-60d360e3-2185-49af-90a5-6ed44513002a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed81e0c7-a44e-497b-bf2e-cf208dd340de", "tag": "66e19dd9-9d9b-4c52-9617-acf66e3f62d9"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:05:51.857017 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8385fe24-d412-482f-99bf-97097500788d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1554 microversion: 2.1 time: 0.240005 Jun 28 12:05:51.857619 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 125/222] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:51 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1554 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:51.870164 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-c3f5476f-f1e2-4eec-a37c-1bd19ecea718 req-60d360e3-2185-49af-90a5-6ed44513002a service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:51.870605 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-c3f5476f-f1e2-4eec-a37c-1bd19ecea718 req-60d360e3-2185-49af-90a5-6ed44513002a service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:51.885577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-c3f5476f-f1e2-4eec-a37c-1bd19ecea718 req-60d360e3-2185-49af-90a5-6ed44513002a service nova] Creating event network-changed:66e19dd9-9d9b-4c52-9617-acf66e3f62d9 for instance ed81e0c7-a44e-497b-bf2e-cf208dd340de on hv-cinder-84795 Jun 28 12:05:51.895641 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-c3f5476f-f1e2-4eec-a37c-1bd19ecea718 req-60d360e3-2185-49af-90a5-6ed44513002a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047298 Jun 28 12:05:51.896262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 98/223] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:05:52.862748 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-88448022-2320-4067-8ec9-5851e0f9b2a1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:52.863313 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-88448022-2320-4067-8ec9-5851e0f9b2a1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:52.875665 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e7fce7c7-1010-401b-8eff-fb6bd68f8710 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:52.876452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e7fce7c7-1010-401b-8eff-fb6bd68f8710 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:52.880490 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-88448022-2320-4067-8ec9-5851e0f9b2a1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:52.882739 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-88448022-2320-4067-8ec9-5851e0f9b2a1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:52.883654 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-88448022-2320-4067-8ec9-5851e0f9b2a1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:52.885744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7fce7c7-1010-401b-8eff-fb6bd68f8710 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:52.886233 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-88448022-2320-4067-8ec9-5851e0f9b2a1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:52.890842 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7fce7c7-1010-401b-8eff-fb6bd68f8710 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:52.891776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7fce7c7-1010-401b-8eff-fb6bd68f8710 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:52.892578 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e7fce7c7-1010-401b-8eff-fb6bd68f8710 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:53.046681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e7fce7c7-1010-401b-8eff-fb6bd68f8710 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:53.055283 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e7fce7c7-1010-401b-8eff-fb6bd68f8710 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1554 microversion: 2.1 time: 0.184349 Jun 28 12:05:53.056004 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 99/224] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:52 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:53.067679 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-88448022-2320-4067-8ec9-5851e0f9b2a1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:53.079206 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-88448022-2320-4067-8ec9-5851e0f9b2a1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.220417 Jun 28 12:05:53.079980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 126/225] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:52 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:54.073140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7c72f05e-0866-4876-9583-fdb8f99d3522 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:54.073829 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7c72f05e-0866-4876-9583-fdb8f99d3522 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:54.081532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c72f05e-0866-4876-9583-fdb8f99d3522 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:54.081981 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c72f05e-0866-4876-9583-fdb8f99d3522 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:54.082749 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c72f05e-0866-4876-9583-fdb8f99d3522 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:54.083184 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c72f05e-0866-4876-9583-fdb8f99d3522 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:54.097198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-86505a84-978a-44cc-9d2e-e059dadff839 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:54.097830 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-86505a84-978a-44cc-9d2e-e059dadff839 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:54.105106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86505a84-978a-44cc-9d2e-e059dadff839 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:54.105536 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86505a84-978a-44cc-9d2e-e059dadff839 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:54.106336 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86505a84-978a-44cc-9d2e-e059dadff839 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:54.106751 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-86505a84-978a-44cc-9d2e-e059dadff839 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:54.222643 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7c72f05e-0866-4876-9583-fdb8f99d3522 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:54.231085 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7c72f05e-0866-4876-9583-fdb8f99d3522 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1554 microversion: 2.1 time: 0.161863 Jun 28 12:05:54.231868 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 100/226] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:54 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:54.256499 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-86505a84-978a-44cc-9d2e-e059dadff839 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:54.264183 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-86505a84-978a-44cc-9d2e-e059dadff839 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.170863 Jun 28 12:05:54.264952 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 127/227] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:54 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:05:55.252138 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-311d27e9-3a56-4fc9-b652-cb3d56fd30bc tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:55.252738 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-311d27e9-3a56-4fc9-b652-cb3d56fd30bc tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:55.260879 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-311d27e9-3a56-4fc9-b652-cb3d56fd30bc tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:55.261364 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-311d27e9-3a56-4fc9-b652-cb3d56fd30bc tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:55.262124 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-311d27e9-3a56-4fc9-b652-cb3d56fd30bc tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:55.262558 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-311d27e9-3a56-4fc9-b652-cb3d56fd30bc tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:55.281384 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a9eac0b1-5114-4ac8-9cc2-6c1cb0faa842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:55.281990 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a9eac0b1-5114-4ac8-9cc2-6c1cb0faa842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:55.288937 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9eac0b1-5114-4ac8-9cc2-6c1cb0faa842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:55.289407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9eac0b1-5114-4ac8-9cc2-6c1cb0faa842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:55.290162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9eac0b1-5114-4ac8-9cc2-6c1cb0faa842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:55.290585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a9eac0b1-5114-4ac8-9cc2-6c1cb0faa842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:55.393304 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-311d27e9-3a56-4fc9-b652-cb3d56fd30bc tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:55.401894 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-311d27e9-3a56-4fc9-b652-cb3d56fd30bc tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1554 microversion: 2.1 time: 0.155739 Jun 28 12:05:55.402544 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 101/228] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:55 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:55.427451 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a9eac0b1-5114-4ac8-9cc2-6c1cb0faa842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:55.435145 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a9eac0b1-5114-4ac8-9cc2-6c1cb0faa842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.157700 Jun 28 12:05:55.435745 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 128/229] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:55 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:56.423127 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2065224b-580f-4346-a866-eba0f7650e63 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:56.424142 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2065224b-580f-4346-a866-eba0f7650e63 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:56.428152 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:56.433867 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2065224b-580f-4346-a866-eba0f7650e63 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:56.434313 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2065224b-580f-4346-a866-eba0f7650e63 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:56.435072 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2065224b-580f-4346-a866-eba0f7650e63 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:56.435502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2065224b-580f-4346-a866-eba0f7650e63 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:56.455059 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-72541033-7364-48df-93a0-2acb3ff17c82 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:56.455704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-72541033-7364-48df-93a0-2acb3ff17c82 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:56.462038 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72541033-7364-48df-93a0-2acb3ff17c82 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:56.462487 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72541033-7364-48df-93a0-2acb3ff17c82 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:56.463246 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72541033-7364-48df-93a0-2acb3ff17c82 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:56.463676 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72541033-7364-48df-93a0-2acb3ff17c82 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:56.577557 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2065224b-580f-4346-a866-eba0f7650e63 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:56.588435 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2065224b-580f-4346-a866-eba0f7650e63 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1554 microversion: 2.1 time: 0.171770 Jun 28 12:05:56.589049 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 102/230] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:56 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:56.599193 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-72541033-7364-48df-93a0-2acb3ff17c82 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:56.607960 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-72541033-7364-48df-93a0-2acb3ff17c82 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.156748 Jun 28 12:05:56.608542 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 129/231] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:56 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:57.607799 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1854be1a-50c0-486e-bfd1-21e5a271c8d4 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:57.608380 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1854be1a-50c0-486e-bfd1-21e5a271c8d4 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:57.615294 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1854be1a-50c0-486e-bfd1-21e5a271c8d4 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:57.616218 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1854be1a-50c0-486e-bfd1-21e5a271c8d4 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:57.617008 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1854be1a-50c0-486e-bfd1-21e5a271c8d4 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:57.617429 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1854be1a-50c0-486e-bfd1-21e5a271c8d4 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:57.621455 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:57.625891 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-25929f7d-e419-4acc-9294-358df6416246 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:57.626504 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-25929f7d-e419-4acc-9294-358df6416246 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:57.633436 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25929f7d-e419-4acc-9294-358df6416246 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:57.633879 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25929f7d-e419-4acc-9294-358df6416246 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:57.634641 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25929f7d-e419-4acc-9294-358df6416246 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:57.635073 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25929f7d-e419-4acc-9294-358df6416246 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:57.756381 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1854be1a-50c0-486e-bfd1-21e5a271c8d4 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:57.765026 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1854be1a-50c0-486e-bfd1-21e5a271c8d4 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1554 microversion: 2.1 time: 0.161057 Jun 28 12:05:57.765885 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 103/232] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:57 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:57.772422 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-25929f7d-e419-4acc-9294-358df6416246 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:57.780362 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-25929f7d-e419-4acc-9294-358df6416246 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.158844 Jun 28 12:05:57.781611 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 130/233] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:57 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:58.782994 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ea47a0b5-0bb5-4b8e-a273-e87a79567f64 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:58.783601 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ea47a0b5-0bb5-4b8e-a273-e87a79567f64 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:58.791223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea47a0b5-0bb5-4b8e-a273-e87a79567f64 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:58.791774 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea47a0b5-0bb5-4b8e-a273-e87a79567f64 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:58.792897 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea47a0b5-0bb5-4b8e-a273-e87a79567f64 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:58.793092 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea47a0b5-0bb5-4b8e-a273-e87a79567f64 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:58.798356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-47670c99-54b0-405a-9372-94ddb7d48d51 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:58.798971 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-47670c99-54b0-405a-9372-94ddb7d48d51 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:58.806177 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-47670c99-54b0-405a-9372-94ddb7d48d51 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:58.806625 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-47670c99-54b0-405a-9372-94ddb7d48d51 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:58.807386 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-47670c99-54b0-405a-9372-94ddb7d48d51 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:58.807815 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-47670c99-54b0-405a-9372-94ddb7d48d51 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:58.812371 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:58.935502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ea47a0b5-0bb5-4b8e-a273-e87a79567f64 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:58.944592 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ea47a0b5-0bb5-4b8e-a273-e87a79567f64 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1554 microversion: 2.1 time: 0.165687 Jun 28 12:05:58.945124 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 104/234] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:58 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:58.950931 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-47670c99-54b0-405a-9372-94ddb7d48d51 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:05:58.958781 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-47670c99-54b0-405a-9372-94ddb7d48d51 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.164724 Jun 28 12:05:58.959334 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 131/235] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:58 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:05:59.961604 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5e667254-e121-4d7f-b588-d8abd052fe41 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:59.962260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5e667254-e121-4d7f-b588-d8abd052fe41 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:59.970664 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e667254-e121-4d7f-b588-d8abd052fe41 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:59.971126 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e667254-e121-4d7f-b588-d8abd052fe41 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:59.971883 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e667254-e121-4d7f-b588-d8abd052fe41 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:59.972306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e667254-e121-4d7f-b588-d8abd052fe41 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:59.986124 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-222cf7f6-63cc-460d-802b-1de9059a48e6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:05:59.986124 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-222cf7f6-63cc-460d-802b-1de9059a48e6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:05:59.992598 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-222cf7f6-63cc-460d-802b-1de9059a48e6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:59.993505 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-222cf7f6-63cc-460d-802b-1de9059a48e6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:05:59.993840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-222cf7f6-63cc-460d-802b-1de9059a48e6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:05:59.994276 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-222cf7f6-63cc-460d-802b-1de9059a48e6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:00.008989 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:00.070083 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5e667254-e121-4d7f-b588-d8abd052fe41 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:00.078619 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5e667254-e121-4d7f-b588-d8abd052fe41 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1512 microversion: 2.1 time: 0.121404 Jun 28 12:06:00.081077 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 105/236] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:59 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1512 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:00.085304 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-cb4d1349-f13e-454a-a284-a8647b093ae9 req-5676639c-e5c2-425f-922e-f7d92e54f497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fea86db2-6a76-4e24-b41c-ab22b7f1d759", "name": "network-vif-deleted", "tag": "63424f2c-afc9-4ae8-835f-0daf13f6f344"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:06:00.094168 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-cb4d1349-f13e-454a-a284-a8647b093ae9 req-5676639c-e5c2-425f-922e-f7d92e54f497 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:00.094606 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-cb4d1349-f13e-454a-a284-a8647b093ae9 req-5676639c-e5c2-425f-922e-f7d92e54f497 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:00.109900 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-cb4d1349-f13e-454a-a284-a8647b093ae9 req-5676639c-e5c2-425f-922e-f7d92e54f497 service nova] Creating event network-vif-deleted:63424f2c-afc9-4ae8-835f-0daf13f6f344 for instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 on hv-cinder-84795 Jun 28 12:06:00.116337 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-cb4d1349-f13e-454a-a284-a8647b093ae9 req-5676639c-e5c2-425f-922e-f7d92e54f497 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035416 Jun 28 12:06:00.117317 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 106/237] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:00.167286 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-222cf7f6-63cc-460d-802b-1de9059a48e6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:00.174828 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-222cf7f6-63cc-460d-802b-1de9059a48e6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.197105 Jun 28 12:06:00.178056 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 132/238] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:05:59 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:01.097116 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-de4ee81a-9c98-422a-82d3-e0711293448d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:01.097806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-de4ee81a-9c98-422a-82d3-e0711293448d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:01.105979 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de4ee81a-9c98-422a-82d3-e0711293448d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:01.106851 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de4ee81a-9c98-422a-82d3-e0711293448d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:01.107628 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de4ee81a-9c98-422a-82d3-e0711293448d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:01.108060 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de4ee81a-9c98-422a-82d3-e0711293448d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:01.194032 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-901b5d7b-04f1-4f8e-b5a2-ae4863b92b3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:01.194779 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-901b5d7b-04f1-4f8e-b5a2-ae4863b92b3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:01.203941 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-de4ee81a-9c98-422a-82d3-e0711293448d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6275dbb33b544dcb91453a858073606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1632e95c1054b4e89203492e13ad3b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:01.213540 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-901b5d7b-04f1-4f8e-b5a2-ae4863b92b3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:01.215998 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-de4ee81a-9c98-422a-82d3-e0711293448d tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 200 len: 1345 microversion: 2.1 time: 0.123769 Jun 28 12:06:01.216756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-901b5d7b-04f1-4f8e-b5a2-ae4863b92b3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:01.216976 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 107/239] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:01 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 1345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:01.217891 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-901b5d7b-04f1-4f8e-b5a2-ae4863b92b3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:01.222559 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-901b5d7b-04f1-4f8e-b5a2-ae4863b92b3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:01.402232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-901b5d7b-04f1-4f8e-b5a2-ae4863b92b3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:01.412108 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-901b5d7b-04f1-4f8e-b5a2-ae4863b92b3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.223686 Jun 28 12:06:01.413198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 133/240] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:01 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:02.235082 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-02826b44-2556-4daf-a1b8-29becd5f7941 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:02.235659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-02826b44-2556-4daf-a1b8-29becd5f7941 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:02.243169 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02826b44-2556-4daf-a1b8-29becd5f7941 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:02.243574 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02826b44-2556-4daf-a1b8-29becd5f7941 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:02.244362 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02826b44-2556-4daf-a1b8-29becd5f7941 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:02.244828 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02826b44-2556-4daf-a1b8-29becd5f7941 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:02.259329 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-02826b44-2556-4daf-a1b8-29becd5f7941 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] HTTP exception thrown: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-02826b44-2556-4daf-a1b8-29becd5f7941 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Request method failure captured: Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 HTTP/1.1 Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu5O4__mYfFiscXc6ApuRlUwQGK3g4RDEaxyGYvJn_N6IhrtyLFWTWy-RNRNci78NlcUXvOyXRDG5saiTlGU4M9w2c3AA0Ku2_xxnD9yDBeos_eygNDxBqEausIdfJoZw8qShLdm-WyDmBOp4M-QGsLtPuvcfiIIt_MYislU5h9cwJM Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: e1632e95c1054b4e89203492e13ad3b7 Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:06:02.264773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1632e95c1054b4e89203492e13ad3b7"}]}] Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: e1632e95c1054b4e89203492e13ad3b7 Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-DeleteServersTestJSON-1964497284-project Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: d6275dbb33b544dcb91453a858073606 Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-DeleteServersTestJSON-1964497284-project Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:02.266262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'fea86db2-6a76-4e24-b41c-ab22b7f1d759'} Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:06:02.267023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:02.268476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:02.269658 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-02826b44-2556-4daf-a1b8-29becd5f7941 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Returning 404 to user: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:06:02.269658 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-02826b44-2556-4daf-a1b8-29becd5f7941 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 404 len: 111 microversion: 2.1 time: 0.035110 Jun 28 12:06:02.269658 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 108/241] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:02 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:06:02.378160 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b6163476-97de-4942-9116-c306bc7fda77 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:02.379135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b6163476-97de-4942-9116-c306bc7fda77 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:02.385264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6163476-97de-4942-9116-c306bc7fda77 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:02.385694 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6163476-97de-4942-9116-c306bc7fda77 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:02.387039 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6163476-97de-4942-9116-c306bc7fda77 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:02.387458 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b6163476-97de-4942-9116-c306bc7fda77 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:02.400038 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-b6163476-97de-4942-9116-c306bc7fda77 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] HTTP exception thrown: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b6163476-97de-4942-9116-c306bc7fda77 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Request method failure captured: Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759/os-volume_attachments HTTP/1.1 Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5O4__mYfFiscXc6ApuRlUwQGK3g4RDEaxyGYvJn_N6IhrtyLFWTWy-RNRNci78NlcUXvOyXRDG5saiTlGU4M9w2c3AA0Ku2_xxnD9yDBeos_eygNDxBqEausIdfJoZw8qShLdm-WyDmBOp4M-QGsLtPuvcfiIIt_MYislU5h9cwJM Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: e1632e95c1054b4e89203492e13ad3b7 Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:06:02.411702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1632e95c1054b4e89203492e13ad3b7"}]}] Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: e1632e95c1054b4e89203492e13ad3b7 Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-DeleteServersTestJSON-1964497284-project Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: d6275dbb33b544dcb91453a858073606 Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-DeleteServersTestJSON-1964497284-project Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:02.413162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'server_id': 'fea86db2-6a76-4e24-b41c-ab22b7f1d759'} Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:06:02.413927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:02.415368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:02.416677 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b6163476-97de-4942-9116-c306bc7fda77 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Returning 404 to user: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:06:02.416677 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b6163476-97de-4942-9116-c306bc7fda77 tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039134 Jun 28 12:06:02.416677 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 134/242] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:06:02 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:06:02.428746 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0f576c99-93b6-4910-b73a-255e41f3afdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:02.429374 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0f576c99-93b6-4910-b73a-255e41f3afdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:02.436862 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f576c99-93b6-4910-b73a-255e41f3afdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:02.437402 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f576c99-93b6-4910-b73a-255e41f3afdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:02.438161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f576c99-93b6-4910-b73a-255e41f3afdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:02.438592 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f576c99-93b6-4910-b73a-255e41f3afdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:02.589516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0f576c99-93b6-4910-b73a-255e41f3afdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:02.598277 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0f576c99-93b6-4910-b73a-255e41f3afdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.173414 Jun 28 12:06:02.605032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 109/243] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:02 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:03.614758 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ea2310bb-4d5d-426f-85a8-fd5b64a2c9da tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:03.615364 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ea2310bb-4d5d-426f-85a8-fd5b64a2c9da tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:03.621527 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea2310bb-4d5d-426f-85a8-fd5b64a2c9da tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:03.621976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea2310bb-4d5d-426f-85a8-fd5b64a2c9da tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:03.622727 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea2310bb-4d5d-426f-85a8-fd5b64a2c9da tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:03.623214 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ea2310bb-4d5d-426f-85a8-fd5b64a2c9da tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:03.767436 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ea2310bb-4d5d-426f-85a8-fd5b64a2c9da tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:03.774983 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ea2310bb-4d5d-426f-85a8-fd5b64a2c9da tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.164130 Jun 28 12:06:03.775556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 135/244] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:03 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:04.702677 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-97903626-a009-43ed-bb66-a872c798db5f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:04.703285 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-97903626-a009-43ed-bb66-a872c798db5f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:04.718043 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-97903626-a009-43ed-bb66-a872c798db5f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:04.718804 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-97903626-a009-43ed-bb66-a872c798db5f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:04.720101 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-97903626-a009-43ed-bb66-a872c798db5f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:04.720765 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-97903626-a009-43ed-bb66-a872c798db5f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:04.737928 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-97903626-a009-43ed-bb66-a872c798db5f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] HTTP exception thrown: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-97903626-a009-43ed-bb66-a872c798db5f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Request method failure captured: Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 HTTP/1.1 Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu5O4__mYfFiscXc6ApuRlUwQGK3g4RDEaxyGYvJn_N6IhrtyLFWTWy-RNRNci78NlcUXvOyXRDG5saiTlGU4M9w2c3AA0Ku2_xxnD9yDBeos_eygNDxBqEausIdfJoZw8qShLdm-WyDmBOp4M-QGsLtPuvcfiIIt_MYislU5h9cwJM Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: e1632e95c1054b4e89203492e13ad3b7 Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:06:04.739794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1632e95c1054b4e89203492e13ad3b7"}]}] Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: e1632e95c1054b4e89203492e13ad3b7 Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-DeleteServersTestJSON-1964497284-project Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: d6275dbb33b544dcb91453a858073606 Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-DeleteServersTestJSON-1964497284-project Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:04.741303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'fea86db2-6a76-4e24-b41c-ab22b7f1d759'} Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:06:04.742175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:04.744778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:04.747542 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-97903626-a009-43ed-bb66-a872c798db5f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Returning 404 to user: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:06:04.747542 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-97903626-a009-43ed-bb66-a872c798db5f tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 404 len: 111 microversion: 2.1 time: 0.043598 Jun 28 12:06:04.747542 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 110/245] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:06:04 2022] DELETE /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:06:04.754515 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4dbcdf3b-020b-4e47-bb9e-3ddeb00e2d5e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:04.756037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4dbcdf3b-020b-4e47-bb9e-3ddeb00e2d5e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] [instance: fea86db2-6a76-4e24-b41c-ab22b7f1d759] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:04.764424 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4dbcdf3b-020b-4e47-bb9e-3ddeb00e2d5e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:04.765012 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4dbcdf3b-020b-4e47-bb9e-3ddeb00e2d5e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:04.766229 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4dbcdf3b-020b-4e47-bb9e-3ddeb00e2d5e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:04.766731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4dbcdf3b-020b-4e47-bb9e-3ddeb00e2d5e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:04.783799 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-4dbcdf3b-020b-4e47-bb9e-3ddeb00e2d5e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] HTTP exception thrown: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4dbcdf3b-020b-4e47-bb9e-3ddeb00e2d5e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Request method failure captured: Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 HTTP/1.1 Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5O4__mYfFiscXc6ApuRlUwQGK3g4RDEaxyGYvJn_N6IhrtyLFWTWy-RNRNci78NlcUXvOyXRDG5saiTlGU4M9w2c3AA0Ku2_xxnD9yDBeos_eygNDxBqEausIdfJoZw8qShLdm-WyDmBOp4M-QGsLtPuvcfiIIt_MYislU5h9cwJM Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: e1632e95c1054b4e89203492e13ad3b7 Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:06:04.785992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e1632e95c1054b4e89203492e13ad3b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e1632e95c1054b4e89203492e13ad3b7"}]}] Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: e1632e95c1054b4e89203492e13ad3b7 Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-DeleteServersTestJSON-1964497284 Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-DeleteServersTestJSON-1964497284-project Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: d6275dbb33b544dcb91453a858073606 Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-DeleteServersTestJSON-1964497284-project Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:04.787416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': 'fea86db2-6a76-4e24-b41c-ab22b7f1d759'} Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:06:04.788181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. Jun 28 12:06:04.790099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:04.791198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4dbcdf3b-020b-4e47-bb9e-3ddeb00e2d5e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] Returning 404 to user: Instance fea86db2-6a76-4e24-b41c-ab22b7f1d759 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:06:04.791198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4dbcdf3b-020b-4e47-bb9e-3ddeb00e2d5e tempest-DeleteServersTestJSON-1964497284 tempest-DeleteServersTestJSON-1964497284-project] 10.222.0.55 "GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759" status: 404 len: 111 microversion: 2.1 time: 0.038099 Jun 28 12:06:04.791198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 136/246] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:04 2022] GET /compute/v2.1/servers/fea86db2-6a76-4e24-b41c-ab22b7f1d759 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:06:04.804169 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bef33c43-b7b0-41b1-9abb-fa61d174f6d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:04.804794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bef33c43-b7b0-41b1-9abb-fa61d174f6d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:04.811780 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bef33c43-b7b0-41b1-9abb-fa61d174f6d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:04.811997 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bef33c43-b7b0-41b1-9abb-fa61d174f6d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:04.812935 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bef33c43-b7b0-41b1-9abb-fa61d174f6d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:04.814027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bef33c43-b7b0-41b1-9abb-fa61d174f6d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:04.995672 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bef33c43-b7b0-41b1-9abb-fa61d174f6d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:05.010015 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bef33c43-b7b0-41b1-9abb-fa61d174f6d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.218117 Jun 28 12:06:05.011167 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 111/247] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:04 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:06.031597 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-99ec4ccd-0bf0-4950-ad53-97d954158724 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:06.033956 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-99ec4ccd-0bf0-4950-ad53-97d954158724 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:06.043272 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-99ec4ccd-0bf0-4950-ad53-97d954158724 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:06.044148 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-99ec4ccd-0bf0-4950-ad53-97d954158724 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:06.045282 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-99ec4ccd-0bf0-4950-ad53-97d954158724 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:06.046009 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-99ec4ccd-0bf0-4950-ad53-97d954158724 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:06.513191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-99ec4ccd-0bf0-4950-ad53-97d954158724 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:06.520980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-99ec4ccd-0bf0-4950-ad53-97d954158724 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.497060 Jun 28 12:06:06.521804 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 137/248] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:06 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:07.538818 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-32610f53-2922-49db-9345-0456c1170c26 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:07.539409 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-32610f53-2922-49db-9345-0456c1170c26 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:07.546421 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32610f53-2922-49db-9345-0456c1170c26 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:07.546866 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32610f53-2922-49db-9345-0456c1170c26 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:07.547676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32610f53-2922-49db-9345-0456c1170c26 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:07.548111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32610f53-2922-49db-9345-0456c1170c26 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:07.802123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-32610f53-2922-49db-9345-0456c1170c26 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:07.809892 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-32610f53-2922-49db-9345-0456c1170c26 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.275239 Jun 28 12:06:07.810459 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 112/249] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:07 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:08.827458 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eb34e7c1-e99f-49a0-88f3-ac524acdc655 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:08.828057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eb34e7c1-e99f-49a0-88f3-ac524acdc655 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:08.834243 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb34e7c1-e99f-49a0-88f3-ac524acdc655 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:08.834683 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb34e7c1-e99f-49a0-88f3-ac524acdc655 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:08.835450 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb34e7c1-e99f-49a0-88f3-ac524acdc655 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:08.835881 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb34e7c1-e99f-49a0-88f3-ac524acdc655 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:08.975624 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-eb34e7c1-e99f-49a0-88f3-ac524acdc655 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:08.983480 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-eb34e7c1-e99f-49a0-88f3-ac524acdc655 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.159923 Jun 28 12:06:08.984048 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 138/250] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:08 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:06:09.890608 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eaf936b1-624d-4ae2-b830-fa905c76bb0e tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Action: 'create', calling method: .version_select at 0x7f39337b21f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1215808214", "metadata": {"Type": "work"}}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:06:10.001191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fc2058cc-4ff1-4f23-afde-c5d8653517af tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:10.002375 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fc2058cc-4ff1-4f23-afde-c5d8653517af tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:10.008731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc2058cc-4ff1-4f23-afde-c5d8653517af tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:10.009209 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc2058cc-4ff1-4f23-afde-c5d8653517af tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:10.009987 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc2058cc-4ff1-4f23-afde-c5d8653517af tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:10.010417 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc2058cc-4ff1-4f23-afde-c5d8653517af tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:10.157379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fc2058cc-4ff1-4f23-afde-c5d8653517af tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:10.165744 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fc2058cc-4ff1-4f23-afde-c5d8653517af tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.168396 Jun 28 12:06:10.166596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 139/251] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:09 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:10.206708 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eaf936b1-624d-4ae2-b830-fa905c76bb0e tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.439309 Jun 28 12:06:10.207509 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 113/252] 10.222.0.55 () {60 vars in 1155 bytes} [Tue Jun 28 12:06:09 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 441 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 28 12:06:10.222031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2c55d214-00ca-4e18-959d-fed50c2fcb68 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932e34ca0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:10.275418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2c55d214-00ca-4e18-959d-fed50c2fcb68 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 353 microversion: 2.1 time: 0.060740 Jun 28 12:06:10.276024 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 140/253] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:10 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:11.182976 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a703c15d-ef45-45c3-98a1-10a16ee12b39 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:11.183619 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a703c15d-ef45-45c3-98a1-10a16ee12b39 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:11.192951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a703c15d-ef45-45c3-98a1-10a16ee12b39 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:11.193415 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a703c15d-ef45-45c3-98a1-10a16ee12b39 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:11.194185 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a703c15d-ef45-45c3-98a1-10a16ee12b39 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:11.194622 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a703c15d-ef45-45c3-98a1-10a16ee12b39 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:11.287881 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bfd4d6e1-9504-4e39-8057-06b3e43c6baf tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932e28790>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:11.336645 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a703c15d-ef45-45c3-98a1-10a16ee12b39 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:11.338212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bfd4d6e1-9504-4e39-8057-06b3e43c6baf tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 353 microversion: 2.1 time: 0.054145 Jun 28 12:06:11.338787 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 141/254] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:11 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:11.345047 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a703c15d-ef45-45c3-98a1-10a16ee12b39 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.165845 Jun 28 12:06:11.345641 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 114/255] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:11 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:12.351242 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-30b92941-e74c-4cb9-8d31-cfad889f7b55 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932e06f70>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:12.362249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-641c1f54-eb91-4bc5-b206-df0d241a1b22 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:12.362867 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-641c1f54-eb91-4bc5-b206-df0d241a1b22 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:12.369560 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-641c1f54-eb91-4bc5-b206-df0d241a1b22 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:12.370006 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-641c1f54-eb91-4bc5-b206-df0d241a1b22 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:12.370780 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-641c1f54-eb91-4bc5-b206-df0d241a1b22 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:12.371250 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-641c1f54-eb91-4bc5-b206-df0d241a1b22 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:12.402548 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-30b92941-e74c-4cb9-8d31-cfad889f7b55 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 353 microversion: 2.1 time: 0.055099 Jun 28 12:06:12.403179 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 142/256] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:12 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:12.511992 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-641c1f54-eb91-4bc5-b206-df0d241a1b22 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:12.520109 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-641c1f54-eb91-4bc5-b206-df0d241a1b22 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.161987 Jun 28 12:06:12.520693 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 115/257] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:12 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:13.418449 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-363ee3e0-cfb5-4c5e-af29-1f67948c7e16 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932dd5550>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:13.478728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-363ee3e0-cfb5-4c5e-af29-1f67948c7e16 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 353 microversion: 2.1 time: 0.066695 Jun 28 12:06:13.479306 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 143/258] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:13 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:13.539407 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2b6575c8-4fd7-4201-9d2f-2af80989a5e7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:13.539407 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2b6575c8-4fd7-4201-9d2f-2af80989a5e7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:13.545933 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b6575c8-4fd7-4201-9d2f-2af80989a5e7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:13.546587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b6575c8-4fd7-4201-9d2f-2af80989a5e7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:13.555811 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b6575c8-4fd7-4201-9d2f-2af80989a5e7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:13.555811 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b6575c8-4fd7-4201-9d2f-2af80989a5e7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:13.685883 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2b6575c8-4fd7-4201-9d2f-2af80989a5e7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:13.694775 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2b6575c8-4fd7-4201-9d2f-2af80989a5e7 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.161176 Jun 28 12:06:13.695353 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 116/259] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:13 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:14.492520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5a99e182-ddef-4f1e-bdf6-45b79c57dccf tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932e340d0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:14.544078 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5a99e182-ddef-4f1e-bdf6-45b79c57dccf tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 353 microversion: 2.1 time: 0.055404 Jun 28 12:06:14.544648 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 144/260] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:14 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:14.712232 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7d96fa7c-50e7-47bd-b01b-534087c3a842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:14.712840 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7d96fa7c-50e7-47bd-b01b-534087c3a842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:14.720362 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d96fa7c-50e7-47bd-b01b-534087c3a842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:14.720822 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d96fa7c-50e7-47bd-b01b-534087c3a842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:14.721944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d96fa7c-50e7-47bd-b01b-534087c3a842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:14.722382 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d96fa7c-50e7-47bd-b01b-534087c3a842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:14.863707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7d96fa7c-50e7-47bd-b01b-534087c3a842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:14.871246 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7d96fa7c-50e7-47bd-b01b-534087c3a842 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.162915 Jun 28 12:06:14.871794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 117/261] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:14 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:15.557052 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f16f6b1e-ed05-422f-a9a9-b961b5b82ce6 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932e34b80>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:15.607185 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f16f6b1e-ed05-422f-a9a9-b961b5b82ce6 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 353 microversion: 2.1 time: 0.053945 Jun 28 12:06:15.607789 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 145/262] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:15 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:15.888456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a889b1cf-5d49-4bcb-9272-cf9a8782b82a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:15.889097 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a889b1cf-5d49-4bcb-9272-cf9a8782b82a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:15.896203 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a889b1cf-5d49-4bcb-9272-cf9a8782b82a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:15.896998 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a889b1cf-5d49-4bcb-9272-cf9a8782b82a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:15.897749 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a889b1cf-5d49-4bcb-9272-cf9a8782b82a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:15.898187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a889b1cf-5d49-4bcb-9272-cf9a8782b82a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:16.042258 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a889b1cf-5d49-4bcb-9272-cf9a8782b82a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:16.049997 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a889b1cf-5d49-4bcb-9272-cf9a8782b82a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.165245 Jun 28 12:06:16.050815 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 118/263] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:15 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:16.620692 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5aa0d72f-de95-4be8-8ea0-a3151bab13df tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932fa78b0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:16.678605 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5aa0d72f-de95-4be8-8ea0-a3151bab13df tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 354 microversion: 2.1 time: 0.061791 Jun 28 12:06:16.679184 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 146/264] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:16 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:16.692265 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e6e60b68-ee54-4b64-a0d0-da80656b0de9 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932f50c10>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:16.752003 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e6e60b68-ee54-4b64-a0d0-da80656b0de9 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 354 microversion: 2.1 time: 0.063436 Jun 28 12:06:16.752573 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 119/265] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:16 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:16.769684 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2a23d4ff-a83a-4193-bc7f-6c4ff938866c tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932e28670>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:16.834159 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2a23d4ff-a83a-4193-bc7f-6c4ff938866c tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 202 len: 0 microversion: 2.1 time: 0.068771 Jun 28 12:06:16.834726 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 147/266] 10.222.0.55 () {58 vars in 1247 bytes} [Tue Jun 28 12:06:16 2022] DELETE /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:06:16.844617 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7cc7eb8b-b5ff-490a-b7b7-57912ab05f5a tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932f6fb80>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:16.896308 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7cc7eb8b-b5ff-490a-b7b7-57912ab05f5a tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 353 microversion: 2.1 time: 0.055874 Jun 28 12:06:16.896870 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 120/267] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:16 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:06:17.068760 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d9eb969a-253f-4575-b123-fa3546e48ef5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:17.069513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d9eb969a-253f-4575-b123-fa3546e48ef5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:17.075742 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9eb969a-253f-4575-b123-fa3546e48ef5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:17.076193 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9eb969a-253f-4575-b123-fa3546e48ef5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:17.076948 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9eb969a-253f-4575-b123-fa3546e48ef5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:17.077381 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d9eb969a-253f-4575-b123-fa3546e48ef5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:17.207319 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d9eb969a-253f-4575-b123-fa3546e48ef5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:17.215266 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d9eb969a-253f-4575-b123-fa3546e48ef5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.151488 Jun 28 12:06:17.215826 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 148/268] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:17 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:17.910842 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-46c90237-4f4b-4d97-9e84-87da1aa3bf5c tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f39337b2040>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:17.960864 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-46c90237-4f4b-4d97-9e84-87da1aa3bf5c tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 353 microversion: 2.1 time: 0.055049 Jun 28 12:06:17.961660 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 121/269] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:17 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:18.233299 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-00b05fe7-5c99-44e6-98b2-e45e36db0130 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:18.233984 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-00b05fe7-5c99-44e6-98b2-e45e36db0130 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:18.240820 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00b05fe7-5c99-44e6-98b2-e45e36db0130 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:18.241308 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00b05fe7-5c99-44e6-98b2-e45e36db0130 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:18.242078 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00b05fe7-5c99-44e6-98b2-e45e36db0130 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:18.242490 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00b05fe7-5c99-44e6-98b2-e45e36db0130 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:18.389672 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-00b05fe7-5c99-44e6-98b2-e45e36db0130 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:18.398023 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-00b05fe7-5c99-44e6-98b2-e45e36db0130 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1522 microversion: 2.1 time: 0.168825 Jun 28 12:06:18.398588 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 149/270] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:18 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:18.980519 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f6897bcd-a174-42b2-8694-af5df9271480 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932f6f5e0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:19.031307 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f6897bcd-a174-42b2-8694-af5df9271480 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 353 microversion: 2.1 time: 0.058079 Jun 28 12:06:19.031870 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 122/271] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:18 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:19.416029 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7c56070-e46d-4b61-b478-634881c6a38f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:19.416770 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a7c56070-e46d-4b61-b478-634881c6a38f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:19.418697 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:19.423992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7c56070-e46d-4b61-b478-634881c6a38f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:19.424431 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7c56070-e46d-4b61-b478-634881c6a38f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:19.425708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7c56070-e46d-4b61-b478-634881c6a38f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:19.426138 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7c56070-e46d-4b61-b478-634881c6a38f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:19.564041 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a7c56070-e46d-4b61-b478-634881c6a38f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:19.572370 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a7c56070-e46d-4b61-b478-634881c6a38f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1502 microversion: 2.1 time: 0.160411 Jun 28 12:06:19.572951 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 150/272] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:19 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:19.589250 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bf0b5168-b9ca-4343-81a9-595795d7a875 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:19.589834 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bf0b5168-b9ca-4343-81a9-595795d7a875 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:19.600422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf0b5168-b9ca-4343-81a9-595795d7a875 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:19.600873 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf0b5168-b9ca-4343-81a9-595795d7a875 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:19.601659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf0b5168-b9ca-4343-81a9-595795d7a875 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:19.602088 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf0b5168-b9ca-4343-81a9-595795d7a875 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:19.733817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf0b5168-b9ca-4343-81a9-595795d7a875 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:19.741672 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bf0b5168-b9ca-4343-81a9-595795d7a875 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1516 microversion: 2.1 time: 0.156344 Jun 28 12:06:19.744941 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 123/273] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:19 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:20.044472 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b9732051-9082-4ccc-9121-db2054b67b0a tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932e34820>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:20.125102 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b9732051-9082-4ccc-9121-db2054b67b0a tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 353 microversion: 2.1 time: 0.084929 Jun 28 12:06:20.125538 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 151/274] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:20 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:21.138559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c2860458-a74e-4a94-8934-462ae1ad9555 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f3932f6f820>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:21.187571 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c2860458-a74e-4a94-8934-462ae1ad9555 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 200 len: 353 microversion: 2.1 time: 0.052806 Jun 28 12:06:21.188158 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 124/275] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:21 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:06:22.182218 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bfba21da-6317-431f-bd8b-cadba1df4c96 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:06:22.183197 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bfba21da-6317-431f-bd8b-cadba1df4c96 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:22.189678 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bfba21da-6317-431f-bd8b-cadba1df4c96 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:22.190128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bfba21da-6317-431f-bd8b-cadba1df4c96 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:22.190891 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bfba21da-6317-431f-bd8b-cadba1df4c96 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:22.191320 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bfba21da-6317-431f-bd8b-cadba1df4c96 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:22.200218 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-03b1ccd1-821f-4dbf-b51e-f783f8b4a3b3 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Calling method '.version_select at 0x7f393816cf70>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:22.214991 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-bfba21da-6317-431f-bd8b-cadba1df4c96 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lazy-loading 'flavor' on Instance uuid 46baa815-7582-46ae-a0ea-3d29be972512 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:06:22.238642 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-03b1ccd1-821f-4dbf-b51e-f783f8b4a3b3 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] HTTP exception thrown: Volume 5ed9f154-0306-47ec-8573-e8d7be32bdb5 could not be found. Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-03b1ccd1-821f-4dbf-b51e-f783f8b4a3b3 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Request method failure captured: Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 HTTP/1.1 Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu6xT6pyMGcWj4KVImGFzpHrp8a_7BXYPUhfbTRSKvJRfGwXpuCPw4QDXTr1MM-Otj5oT5Wyn7tBzPErclShpsnS_iGxYI4NZrnDu0MqBCwBqw3U2D5qR56vT-rscThNUoP6KDdnR_XOLcbT4WQ6AuQXGuHT7t_F7eV-AS1BWDJSLjY Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: d07093b82f094ae398180a96c2d335f3 Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesGetTestJSON-1897995953 Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:06:22.244654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d07093b82f094ae398180a96c2d335f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d07093b82f094ae398180a96c2d335f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d07093b82f094ae398180a96c2d335f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d07093b82f094ae398180a96c2d335f3"}]}] Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesGetTestJSON-1897995953 Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: d07093b82f094ae398180a96c2d335f3 Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesGetTestJSON-1897995953 Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesGetTestJSON-1897995953-project Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: 55dcf415863e4a948edab00c7bff5f98 Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesGetTestJSON-1897995953-project Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Volume 5ed9f154-0306-47ec-8573-e8d7be32bdb5 could not be found. Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '5ed9f154-0306-47ec-8573-e8d7be32bdb5'} Jun 28 12:06:22.246286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ed9f154-0306-47ec-8573-e8d7be32bdb5 could not be found. (HTTP 404) (Request-ID: req-184a1c61-96c1-4490-b948-8552f2b06b9d) Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:22.247249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 12:06:22.248532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ed9f154-0306-47ec-8573-e8d7be32bdb5 could not be found. Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 12:06:22.249771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ed9f154-0306-47ec-8573-e8d7be32bdb5 could not be found. Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ed9f154-0306-47ec-8573-e8d7be32bdb5 could not be found. Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-03b1ccd1-821f-4dbf-b51e-f783f8b4a3b3 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] Returning 404 to user: Volume 5ed9f154-0306-47ec-8573-e8d7be32bdb5 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:06:22.250970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-03b1ccd1-821f-4dbf-b51e-f783f8b4a3b3 tempest-VolumesGetTestJSON-1897995953 tempest-VolumesGetTestJSON-1897995953-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5" status: 404 len: 109 microversion: 2.1 time: 0.050691 Jun 28 12:06:22.252156 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 125/276] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:06:22 2022] GET /compute/v2.1/os-volumes/5ed9f154-0306-47ec-8573-e8d7be32bdb5 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 12:06:22.316105 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bfba21da-6317-431f-bd8b-cadba1df4c96 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "POST /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512/action" status: 200 len: 32 microversion: 2.1 time: 0.138023 Jun 28 12:06:22.317449 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 152/277] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:06:22 2022] POST /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512/action => generated 32 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 28 12:06:22.328729 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6e9cddc3-d782-4bf9-9b72-99262c8283c5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:22.329456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6e9cddc3-d782-4bf9-9b72-99262c8283c5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:22.338365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e9cddc3-d782-4bf9-9b72-99262c8283c5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:22.339867 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e9cddc3-d782-4bf9-9b72-99262c8283c5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:22.341549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e9cddc3-d782-4bf9-9b72-99262c8283c5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:22.343356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e9cddc3-d782-4bf9-9b72-99262c8283c5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:22.587150 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6e9cddc3-d782-4bf9-9b72-99262c8283c5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:22.597011 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6e9cddc3-d782-4bf9-9b72-99262c8283c5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.273645 Jun 28 12:06:22.597600 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 126/278] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:22 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:23.616401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-02f5c6f1-f503-40bd-a0a7-c178d90385cf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:23.617457 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-02f5c6f1-f503-40bd-a0a7-c178d90385cf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:23.627507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02f5c6f1-f503-40bd-a0a7-c178d90385cf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:23.628035 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02f5c6f1-f503-40bd-a0a7-c178d90385cf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:23.628723 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02f5c6f1-f503-40bd-a0a7-c178d90385cf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:23.629183 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-02f5c6f1-f503-40bd-a0a7-c178d90385cf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:23.840207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-02f5c6f1-f503-40bd-a0a7-c178d90385cf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:23.853097 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-02f5c6f1-f503-40bd-a0a7-c178d90385cf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.240964 Jun 28 12:06:23.853678 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 153/279] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:23 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:24.870218 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e1666ad-ed93-48a2-acef-12840a3d74a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:24.871412 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e1666ad-ed93-48a2-acef-12840a3d74a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:24.878586 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e1666ad-ed93-48a2-acef-12840a3d74a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:24.879057 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e1666ad-ed93-48a2-acef-12840a3d74a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:24.879825 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e1666ad-ed93-48a2-acef-12840a3d74a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:24.880423 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e1666ad-ed93-48a2-acef-12840a3d74a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:25.022482 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e1666ad-ed93-48a2-acef-12840a3d74a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:25.030957 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e1666ad-ed93-48a2-acef-12840a3d74a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.164587 Jun 28 12:06:25.040852 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 127/280] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:24 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:26.048249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7dac317f-5239-4d86-bd9d-50c2b486df7d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:26.048854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7dac317f-5239-4d86-bd9d-50c2b486df7d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:26.055397 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dac317f-5239-4d86-bd9d-50c2b486df7d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:26.056143 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dac317f-5239-4d86-bd9d-50c2b486df7d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:26.056928 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dac317f-5239-4d86-bd9d-50c2b486df7d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:26.057369 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dac317f-5239-4d86-bd9d-50c2b486df7d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:26.240288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7dac317f-5239-4d86-bd9d-50c2b486df7d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:26.247920 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7dac317f-5239-4d86-bd9d-50c2b486df7d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.203480 Jun 28 12:06:26.257899 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 154/281] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:26 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:27.265285 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2f8238d8-d66b-4021-ad7e-e6b5737b9aa0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:27.266274 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2f8238d8-d66b-4021-ad7e-e6b5737b9aa0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:27.270477 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=38 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:27.278480 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8238d8-d66b-4021-ad7e-e6b5737b9aa0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:27.287163 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8238d8-d66b-4021-ad7e-e6b5737b9aa0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:27.287886 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8238d8-d66b-4021-ad7e-e6b5737b9aa0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:27.288820 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8238d8-d66b-4021-ad7e-e6b5737b9aa0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:27.445886 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2f8238d8-d66b-4021-ad7e-e6b5737b9aa0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:27.449196 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:27.453990 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2f8238d8-d66b-4021-ad7e-e6b5737b9aa0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.192732 Jun 28 12:06:27.454560 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 128/282] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:27 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:28.472033 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d6d933a6-30a1-446e-bf81-6ae47d9b8edc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:28.472645 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d6d933a6-30a1-446e-bf81-6ae47d9b8edc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:28.479146 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6d933a6-30a1-446e-bf81-6ae47d9b8edc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:28.479580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6d933a6-30a1-446e-bf81-6ae47d9b8edc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:28.480352 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6d933a6-30a1-446e-bf81-6ae47d9b8edc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:28.480779 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6d933a6-30a1-446e-bf81-6ae47d9b8edc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:28.633025 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d6d933a6-30a1-446e-bf81-6ae47d9b8edc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:28.640777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d6d933a6-30a1-446e-bf81-6ae47d9b8edc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.172530 Jun 28 12:06:28.641382 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 155/283] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:28 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:29.658243 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ede24588-ca37-4161-90b4-cb362a3ee727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:29.659547 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ede24588-ca37-4161-90b4-cb362a3ee727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:29.666801 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ede24588-ca37-4161-90b4-cb362a3ee727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:29.667559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ede24588-ca37-4161-90b4-cb362a3ee727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:29.668411 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ede24588-ca37-4161-90b4-cb362a3ee727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:29.668835 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ede24588-ca37-4161-90b4-cb362a3ee727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:29.945239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ede24588-ca37-4161-90b4-cb362a3ee727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:29.953547 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ede24588-ca37-4161-90b4-cb362a3ee727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.299454 Jun 28 12:06:29.954136 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 129/284] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:29 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:30.974030 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6dea6afd-0aa0-4fec-9313-d70e26faf8c0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:30.974715 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6dea6afd-0aa0-4fec-9313-d70e26faf8c0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:30.984017 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6dea6afd-0aa0-4fec-9313-d70e26faf8c0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:30.984651 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6dea6afd-0aa0-4fec-9313-d70e26faf8c0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:30.986111 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6dea6afd-0aa0-4fec-9313-d70e26faf8c0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:30.986691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6dea6afd-0aa0-4fec-9313-d70e26faf8c0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:30.990234 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:31.127868 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6dea6afd-0aa0-4fec-9313-d70e26faf8c0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:31.135595 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6dea6afd-0aa0-4fec-9313-d70e26faf8c0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.166898 Jun 28 12:06:31.136158 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 156/285] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:30 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:32.152938 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f4d7e96f-d34e-4d08-8596-63f8a87a2e18 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:32.153525 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f4d7e96f-d34e-4d08-8596-63f8a87a2e18 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:32.160104 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4d7e96f-d34e-4d08-8596-63f8a87a2e18 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:32.160681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4d7e96f-d34e-4d08-8596-63f8a87a2e18 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:32.161504 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4d7e96f-d34e-4d08-8596-63f8a87a2e18 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:32.161939 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4d7e96f-d34e-4d08-8596-63f8a87a2e18 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:32.299501 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f4d7e96f-d34e-4d08-8596-63f8a87a2e18 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:32.307761 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f4d7e96f-d34e-4d08-8596-63f8a87a2e18 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.158922 Jun 28 12:06:32.308444 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 130/286] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:32 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:33.329274 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-795fcb96-c4d2-4160-933a-3657233f2452 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:33.330302 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-795fcb96-c4d2-4160-933a-3657233f2452 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:33.339211 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-795fcb96-c4d2-4160-933a-3657233f2452 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:33.339653 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-795fcb96-c4d2-4160-933a-3657233f2452 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:33.340398 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-795fcb96-c4d2-4160-933a-3657233f2452 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:33.341212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-795fcb96-c4d2-4160-933a-3657233f2452 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:33.478546 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-795fcb96-c4d2-4160-933a-3657233f2452 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:33.486692 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-795fcb96-c4d2-4160-933a-3657233f2452 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.164128 Jun 28 12:06:33.487259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 157/287] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:33 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:06:34.504083 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ec86d167-2774-4218-a729-1e7b0e7d93d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:34.504760 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ec86d167-2774-4218-a729-1e7b0e7d93d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:34.511032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec86d167-2774-4218-a729-1e7b0e7d93d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:34.511473 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec86d167-2774-4218-a729-1e7b0e7d93d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:34.512238 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec86d167-2774-4218-a729-1e7b0e7d93d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:34.512666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec86d167-2774-4218-a729-1e7b0e7d93d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:34.648810 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ec86d167-2774-4218-a729-1e7b0e7d93d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:34.657226 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ec86d167-2774-4218-a729-1e7b0e7d93d4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.157460 Jun 28 12:06:34.657782 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 131/288] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:34 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:35.679611 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-73433e20-1e3c-47c1-87f0-d6e5c856b689 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:35.681251 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-73433e20-1e3c-47c1-87f0-d6e5c856b689 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:35.690781 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-73433e20-1e3c-47c1-87f0-d6e5c856b689 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:35.691520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-73433e20-1e3c-47c1-87f0-d6e5c856b689 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:35.692781 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-73433e20-1e3c-47c1-87f0-d6e5c856b689 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:35.693814 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-73433e20-1e3c-47c1-87f0-d6e5c856b689 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:35.843801 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-73433e20-1e3c-47c1-87f0-d6e5c856b689 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:35.851408 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-73433e20-1e3c-47c1-87f0-d6e5c856b689 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.178487 Jun 28 12:06:35.851972 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 158/289] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:35 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:36.378523 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1273391201", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1512622342", "security_groups": [{"name": "tempest-secgroup-smoke-1078744139"}], "block_device_mapping_v2": [{"uuid": "edd5f7c6-4c2f-4a35-b4ce-f6b79994ce66", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "460be620-b015-4979-a780-ce463435c616"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:06:36.504861 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] validate_networks() for [('460be620-b015-4979-a780-ce463435c616', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:06:36.869164 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b8c21fc5-7332-4357-a951-ec898f38deb3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:36.869760 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b8c21fc5-7332-4357-a951-ec898f38deb3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:36.876071 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8c21fc5-7332-4357-a951-ec898f38deb3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:36.876516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8c21fc5-7332-4357-a951-ec898f38deb3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:36.877311 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8c21fc5-7332-4357-a951-ec898f38deb3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:36.877741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b8c21fc5-7332-4357-a951-ec898f38deb3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:36.882914 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:06:36.883312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:06:36.883777 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:06:36.884237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:06:36.884874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:06:36.894176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:36.894621 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:36.895402 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:36.895831 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:36.913659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Getting quotas for project 7235a9c7eff24e0e94900ec2abc92ae5. Resources: {'cores', 'ram', 'instances'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:06:36.918209 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Getting quotas for user 9f56095d6bac4f108a73790ac9004f3b and project 7235a9c7eff24e0e94900ec2abc92ae5. Resources: {'cores', 'ram', 'instances'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:06:36.976823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:06:36.979291 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edd5f7c6-4c2f-4a35-b4ce-f6b79994ce66',volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:06:37.012490 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b8c21fc5-7332-4357-a951-ec898f38deb3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:37.020124 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b8c21fc5-7332-4357-a951-ec898f38deb3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.155274 Jun 28 12:06:37.020702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 159/290] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:36 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:37.133003 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4bec2351-af01-4c5b-856e-0c59590c6fcd tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758297 Jun 28 12:06:37.133709 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 132/291] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:06:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:06:37.143865 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-59abbb55-afd1-4c3c-9620-2fc651dcf97f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:37.144544 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-59abbb55-afd1-4c3c-9620-2fc651dcf97f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:37.198195 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-59abbb55-afd1-4c3c-9620-2fc651dcf97f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:37.205403 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-59abbb55-afd1-4c3c-9620-2fc651dcf97f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1095 microversion: 2.1 time: 0.065428 Jun 28 12:06:37.205969 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 160/292] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:37 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:38.041086 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-889f13b2-7a43-4828-9721-142618689200 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:38.041747 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-889f13b2-7a43-4828-9721-142618689200 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:38.050017 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-889f13b2-7a43-4828-9721-142618689200 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:38.050523 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-889f13b2-7a43-4828-9721-142618689200 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:38.051429 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-889f13b2-7a43-4828-9721-142618689200 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:38.051944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-889f13b2-7a43-4828-9721-142618689200 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:38.199055 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-889f13b2-7a43-4828-9721-142618689200 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:38.206772 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-889f13b2-7a43-4828-9721-142618689200 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.172181 Jun 28 12:06:38.207303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 133/293] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:38 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:38.223072 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5510795b-ee48-4b6a-80cb-db083110cc1f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:38.223679 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5510795b-ee48-4b6a-80cb-db083110cc1f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:38.230236 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5510795b-ee48-4b6a-80cb-db083110cc1f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:38.230679 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5510795b-ee48-4b6a-80cb-db083110cc1f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:38.231439 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5510795b-ee48-4b6a-80cb-db083110cc1f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:38.231872 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5510795b-ee48-4b6a-80cb-db083110cc1f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:38.296751 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5510795b-ee48-4b6a-80cb-db083110cc1f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:38.304395 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5510795b-ee48-4b6a-80cb-db083110cc1f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1145 microversion: 2.1 time: 0.085139 Jun 28 12:06:38.304939 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 161/294] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:38 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:39.224535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7b7be5a4-7f27-4d80-b80e-aea97d1101cc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:39.225810 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7b7be5a4-7f27-4d80-b80e-aea97d1101cc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:39.233189 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b7be5a4-7f27-4d80-b80e-aea97d1101cc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:39.233189 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b7be5a4-7f27-4d80-b80e-aea97d1101cc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:39.233835 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b7be5a4-7f27-4d80-b80e-aea97d1101cc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:39.234267 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b7be5a4-7f27-4d80-b80e-aea97d1101cc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:39.322055 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-334a4def-c935-46c6-bf3b-23385ca4f6c0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:39.322765 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-334a4def-c935-46c6-bf3b-23385ca4f6c0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:39.328960 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-334a4def-c935-46c6-bf3b-23385ca4f6c0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:39.329539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-334a4def-c935-46c6-bf3b-23385ca4f6c0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:39.330535 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-334a4def-c935-46c6-bf3b-23385ca4f6c0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:39.331025 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-334a4def-c935-46c6-bf3b-23385ca4f6c0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:39.372031 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7b7be5a4-7f27-4d80-b80e-aea97d1101cc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:39.379635 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7b7be5a4-7f27-4d80-b80e-aea97d1101cc tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.159099 Jun 28 12:06:39.380303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 134/295] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:39 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:39.394596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-334a4def-c935-46c6-bf3b-23385ca4f6c0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:39.402387 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-334a4def-c935-46c6-bf3b-23385ca4f6c0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1137 microversion: 2.1 time: 0.084823 Jun 28 12:06:39.402935 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 162/296] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:39 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:06:40.397594 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0d967124-3fee-47bd-bfa4-ed02d5cdf35e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:40.398156 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0d967124-3fee-47bd-bfa4-ed02d5cdf35e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:40.405301 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d967124-3fee-47bd-bfa4-ed02d5cdf35e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:40.405764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d967124-3fee-47bd-bfa4-ed02d5cdf35e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:40.406551 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d967124-3fee-47bd-bfa4-ed02d5cdf35e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:40.406985 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d967124-3fee-47bd-bfa4-ed02d5cdf35e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:40.420283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-28fdd757-dca7-46db-af3e-6acacab197ad tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:40.420952 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-28fdd757-dca7-46db-af3e-6acacab197ad tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:40.427212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-28fdd757-dca7-46db-af3e-6acacab197ad tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:40.427652 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-28fdd757-dca7-46db-af3e-6acacab197ad tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:40.428412 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-28fdd757-dca7-46db-af3e-6acacab197ad tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:40.428832 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-28fdd757-dca7-46db-af3e-6acacab197ad tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:40.497758 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-28fdd757-dca7-46db-af3e-6acacab197ad tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:40.505538 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-28fdd757-dca7-46db-af3e-6acacab197ad tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1201 microversion: 2.1 time: 0.089767 Jun 28 12:06:40.505943 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 163/297] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:40 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:40.544977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0d967124-3fee-47bd-bfa4-ed02d5cdf35e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:40.552478 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0d967124-3fee-47bd-bfa4-ed02d5cdf35e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.159022 Jun 28 12:06:40.553021 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 135/298] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:40 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:41.523950 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-007fb30e-e238-4ace-803f-46ee6670710e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:41.525774 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-007fb30e-e238-4ace-803f-46ee6670710e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:41.532832 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-007fb30e-e238-4ace-803f-46ee6670710e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:41.533514 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-007fb30e-e238-4ace-803f-46ee6670710e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:41.534660 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-007fb30e-e238-4ace-803f-46ee6670710e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:41.535075 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-007fb30e-e238-4ace-803f-46ee6670710e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:41.573785 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e2a90ef5-8424-4754-8230-1624b7497ac3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:41.574466 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e2a90ef5-8424-4754-8230-1624b7497ac3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:41.591954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2a90ef5-8424-4754-8230-1624b7497ac3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:41.592410 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2a90ef5-8424-4754-8230-1624b7497ac3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:41.593363 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2a90ef5-8424-4754-8230-1624b7497ac3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:41.594150 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2a90ef5-8424-4754-8230-1624b7497ac3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:41.605564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-007fb30e-e238-4ace-803f-46ee6670710e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:41.618402 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-007fb30e-e238-4ace-803f-46ee6670710e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1201 microversion: 2.1 time: 0.098815 Jun 28 12:06:41.621548 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 164/299] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:41 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:06:41.801173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e2a90ef5-8424-4754-8230-1624b7497ac3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:41.814634 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e2a90ef5-8424-4754-8230-1624b7497ac3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.248453 Jun 28 12:06:41.825855 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 136/300] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:41 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:06:42.636215 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c97115f8-8468-4592-b082-d916e58f5327 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:42.636823 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c97115f8-8468-4592-b082-d916e58f5327 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:42.646656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c97115f8-8468-4592-b082-d916e58f5327 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:42.649265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c97115f8-8468-4592-b082-d916e58f5327 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:42.650552 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c97115f8-8468-4592-b082-d916e58f5327 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:42.651249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c97115f8-8468-4592-b082-d916e58f5327 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:42.814333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c97115f8-8468-4592-b082-d916e58f5327 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:42.823357 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c97115f8-8468-4592-b082-d916e58f5327 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1279 microversion: 2.1 time: 0.191177 Jun 28 12:06:42.823935 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 165/301] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:42 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:42.839710 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f5da8b5f-8054-4fde-ac63-a0ba0fc2fbf5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:42.841865 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f5da8b5f-8054-4fde-ac63-a0ba0fc2fbf5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:42.852173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5da8b5f-8054-4fde-ac63-a0ba0fc2fbf5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:42.852831 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5da8b5f-8054-4fde-ac63-a0ba0fc2fbf5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:42.854293 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5da8b5f-8054-4fde-ac63-a0ba0fc2fbf5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:42.854943 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5da8b5f-8054-4fde-ac63-a0ba0fc2fbf5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:43.114518 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f5da8b5f-8054-4fde-ac63-a0ba0fc2fbf5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:43.133040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f5da8b5f-8054-4fde-ac63-a0ba0fc2fbf5 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.298158 Jun 28 12:06:43.135287 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 137/302] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:42 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:43.842052 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7c879593-29a1-4597-b487-071bfe406cb0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:43.842661 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7c879593-29a1-4597-b487-071bfe406cb0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:43.852178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c879593-29a1-4597-b487-071bfe406cb0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:43.852632 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c879593-29a1-4597-b487-071bfe406cb0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:43.860479 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c879593-29a1-4597-b487-071bfe406cb0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:43.860961 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c879593-29a1-4597-b487-071bfe406cb0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:44.147212 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-2220d6b6-d334-4368-8bde-87655a1b1d6b req-15ff6065-f636-4464-908c-db3da62e6a50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d3b43f9-d11c-431b-ae03-a6d4e7186040", "tag": "ff58ffa6-bb00-4617-a737-e6a53540ec91"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:06:44.163187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-2220d6b6-d334-4368-8bde-87655a1b1d6b req-15ff6065-f636-4464-908c-db3da62e6a50 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:44.164762 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-2220d6b6-d334-4368-8bde-87655a1b1d6b req-15ff6065-f636-4464-908c-db3da62e6a50 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:44.182456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-2220d6b6-d334-4368-8bde-87655a1b1d6b req-15ff6065-f636-4464-908c-db3da62e6a50 service nova] Creating event network-changed:ff58ffa6-bb00-4617-a737-e6a53540ec91 for instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 on hv-cinder-84795 Jun 28 12:06:44.191581 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-2220d6b6-d334-4368-8bde-87655a1b1d6b req-15ff6065-f636-4464-908c-db3da62e6a50 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047852 Jun 28 12:06:44.192882 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 138/303] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:06:44.199499 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-694a381d-e131-449b-a492-1a0eeafcf3d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:44.200692 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-694a381d-e131-449b-a492-1a0eeafcf3d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:44.209101 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-694a381d-e131-449b-a492-1a0eeafcf3d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:44.209899 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-694a381d-e131-449b-a492-1a0eeafcf3d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:44.210940 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-694a381d-e131-449b-a492-1a0eeafcf3d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:44.211587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-694a381d-e131-449b-a492-1a0eeafcf3d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:44.247516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7c879593-29a1-4597-b487-071bfe406cb0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:44.257456 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7c879593-29a1-4597-b487-071bfe406cb0 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.418488 Jun 28 12:06:44.259884 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 166/304] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:43 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:44.432648 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-694a381d-e131-449b-a492-1a0eeafcf3d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:44.442568 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-694a381d-e131-449b-a492-1a0eeafcf3d9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1502 microversion: 2.1 time: 0.247762 Jun 28 12:06:44.443144 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 139/305] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:44 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:44.460200 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-95896a4e-43f3-4e7e-9250-610508f46a49 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf1a0684-909a-4e29-877e-55296bbae4f1"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:06:44.461363 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-95896a4e-43f3-4e7e-9250-610508f46a49 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:44.470812 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-95896a4e-43f3-4e7e-9250-610508f46a49 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:44.471529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-95896a4e-43f3-4e7e-9250-610508f46a49 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:44.472445 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-95896a4e-43f3-4e7e-9250-610508f46a49 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:44.473061 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-95896a4e-43f3-4e7e-9250-610508f46a49 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:44.502153 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-95896a4e-43f3-4e7e-9250-610508f46a49 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] HTTP exception thrown: Cannot 'attach_volume' instance 46baa815-7582-46ae-a0ea-3d29be972512 while it is in vm_state rescued Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-95896a4e-43f3-4e7e-9250-610508f46a49 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Request method failure captured: Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: POST /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512/os-volume_attachments HTTP/1.1 Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 74 Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5VDlT0QvxPczxGxa6d8wis3CrxqdLDzd7bXGXutpaSUscJ5Gb-1pWgOZu6QxpID_XWgOURaK8-f2td6BRMTAb_uKmkJnYncQO3XENA9Wfl4DGALMI1JwB0ZHgXr5_-PKiSq-JQVwWMC9av7z2Ev1xD0QZ3LvBbAb5bvqKpzdYUVCU Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: c47f35f9ae5e4a55be23a84e3887b915 Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:06:44.504135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c47f35f9ae5e4a55be23a84e3887b915"}]}] Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: c47f35f9ae5e4a55be23a84e3887b915 Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-ServerRescueNegativeTestJSON-690784627-project Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 2a54e9db924c440da63c04052fe058e6 Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690784627-project Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {"volumeAttachment": {"volumeId": "bf1a0684-909a-4e29-877e-55296bbae4f1"}} Jun 28 12:06:44.505681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Cannot 'attach_volume' instance 46baa815-7582-46ae-a0ea-3d29be972512 while it is in vm_state rescued Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'server_id': '46baa815-7582-46ae-a0ea-3d29be972512', 'body': {'volumeAttachment': {'volumeId': 'bf1a0684-909a-4e29-877e-55296bbae4f1'}}} Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 46baa815-7582-46ae-a0ea-3d29be972512 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:06:44.506517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 46baa815-7582-46ae-a0ea-3d29be972512 while it is in vm_state rescued Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:06:44.507741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:06:44.508982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:06:44.508982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:06:44.508982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 46baa815-7582-46ae-a0ea-3d29be972512 while it is in vm_state rescued Jun 28 12:06:44.508982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:06:44.510861 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-95896a4e-43f3-4e7e-9250-610508f46a49 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Returning 409 to user: Cannot 'attach_volume' instance 46baa815-7582-46ae-a0ea-3d29be972512 while it is in vm_state rescued {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:06:44.512070 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-95896a4e-43f3-4e7e-9250-610508f46a49 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "POST /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055938 Jun 28 12:06:44.516457 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 167/306] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:06:44 2022] POST /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 28 12:06:44.523009 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4d13c689-41c6-40af-9363-60ebf5c2ec2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:06:44.523575 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4d13c689-41c6-40af-9363-60ebf5c2ec2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:44.531594 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d13c689-41c6-40af-9363-60ebf5c2ec2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:44.532093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d13c689-41c6-40af-9363-60ebf5c2ec2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:44.532893 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d13c689-41c6-40af-9363-60ebf5c2ec2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:44.533795 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d13c689-41c6-40af-9363-60ebf5c2ec2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:44.623019 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4d13c689-41c6-40af-9363-60ebf5c2ec2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "POST /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512/action" status: 202 len: 0 microversion: 2.1 time: 0.103611 Jun 28 12:06:44.624813 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 140/307] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:06:44 2022] POST /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:06:44.632816 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b18e74d3-1d7c-44bf-9e8d-615ca1371556 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:44.633765 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b18e74d3-1d7c-44bf-9e8d-615ca1371556 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:44.656295 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b18e74d3-1d7c-44bf-9e8d-615ca1371556 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:44.657713 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b18e74d3-1d7c-44bf-9e8d-615ca1371556 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:44.660335 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b18e74d3-1d7c-44bf-9e8d-615ca1371556 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:44.661055 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b18e74d3-1d7c-44bf-9e8d-615ca1371556 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:45.175806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b18e74d3-1d7c-44bf-9e8d-615ca1371556 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:45.189360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b18e74d3-1d7c-44bf-9e8d-615ca1371556 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.557340 Jun 28 12:06:45.190354 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 168/308] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:44 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:45.277013 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0dffd663-ac8c-4633-b63b-391bf8d3f322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:45.277852 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0dffd663-ac8c-4633-b63b-391bf8d3f322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:45.285662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0dffd663-ac8c-4633-b63b-391bf8d3f322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:45.286297 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0dffd663-ac8c-4633-b63b-391bf8d3f322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:45.287388 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0dffd663-ac8c-4633-b63b-391bf8d3f322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:45.288034 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0dffd663-ac8c-4633-b63b-391bf8d3f322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:45.695210 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0dffd663-ac8c-4633-b63b-391bf8d3f322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:45.704549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0dffd663-ac8c-4633-b63b-391bf8d3f322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.432585 Jun 28 12:06:45.705998 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 141/309] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:45 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:46.208770 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-663cb669-f5a4-453f-af28-39fac23c8630 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:46.210532 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-663cb669-f5a4-453f-af28-39fac23c8630 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:46.218229 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-663cb669-f5a4-453f-af28-39fac23c8630 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:46.219841 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-663cb669-f5a4-453f-af28-39fac23c8630 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:46.221067 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-663cb669-f5a4-453f-af28-39fac23c8630 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:46.221695 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-663cb669-f5a4-453f-af28-39fac23c8630 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:46.633091 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-663cb669-f5a4-453f-af28-39fac23c8630 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:46.643365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-663cb669-f5a4-453f-af28-39fac23c8630 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.440097 Jun 28 12:06:46.643945 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 169/310] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:46 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:46.722327 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a7a4fdf7-2bd2-4d41-a6ed-75b6b1f2c52d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:46.722944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a7a4fdf7-2bd2-4d41-a6ed-75b6b1f2c52d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:46.729503 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7a4fdf7-2bd2-4d41-a6ed-75b6b1f2c52d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:46.730227 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7a4fdf7-2bd2-4d41-a6ed-75b6b1f2c52d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:46.731077 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7a4fdf7-2bd2-4d41-a6ed-75b6b1f2c52d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:46.731564 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7a4fdf7-2bd2-4d41-a6ed-75b6b1f2c52d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:46.896220 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a7a4fdf7-2bd2-4d41-a6ed-75b6b1f2c52d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:46.904019 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:46.907709 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a7a4fdf7-2bd2-4d41-a6ed-75b6b1f2c52d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.188883 Jun 28 12:06:46.908288 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 142/311] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:46 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:47.661348 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0e02a132-003a-407d-a806-282c446311dd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:47.661970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0e02a132-003a-407d-a806-282c446311dd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:47.664236 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:47.670935 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e02a132-003a-407d-a806-282c446311dd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:47.671444 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e02a132-003a-407d-a806-282c446311dd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:47.672297 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e02a132-003a-407d-a806-282c446311dd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:47.672773 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0e02a132-003a-407d-a806-282c446311dd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:47.813181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0e02a132-003a-407d-a806-282c446311dd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:47.821137 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0e02a132-003a-407d-a806-282c446311dd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.163819 Jun 28 12:06:47.821879 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 170/312] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:47 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:47.923714 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f1960306-7f23-4ce3-9df7-7af2b4c6e6fb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:47.924396 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f1960306-7f23-4ce3-9df7-7af2b4c6e6fb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:47.926778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:47.932999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1960306-7f23-4ce3-9df7-7af2b4c6e6fb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:47.933442 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1960306-7f23-4ce3-9df7-7af2b4c6e6fb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:47.934193 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1960306-7f23-4ce3-9df7-7af2b4c6e6fb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:47.934621 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1960306-7f23-4ce3-9df7-7af2b4c6e6fb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:48.095535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f1960306-7f23-4ce3-9df7-7af2b4c6e6fb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:48.103676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f1960306-7f23-4ce3-9df7-7af2b4c6e6fb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.183720 Jun 28 12:06:48.104276 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 143/313] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:47 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:48.839313 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-97845031-6b54-4653-a978-128993f6460a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:48.839898 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-97845031-6b54-4653-a978-128993f6460a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:48.847120 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-97845031-6b54-4653-a978-128993f6460a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:48.847574 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-97845031-6b54-4653-a978-128993f6460a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:48.848349 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-97845031-6b54-4653-a978-128993f6460a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:48.848785 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-97845031-6b54-4653-a978-128993f6460a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:48.994368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-97845031-6b54-4653-a978-128993f6460a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:49.002262 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-97845031-6b54-4653-a978-128993f6460a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.167250 Jun 28 12:06:49.002901 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 171/314] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:48 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:49.119905 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5637a2be-0890-4722-b76f-ff291c901f50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:49.120469 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5637a2be-0890-4722-b76f-ff291c901f50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:49.127248 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5637a2be-0890-4722-b76f-ff291c901f50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:49.127727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5637a2be-0890-4722-b76f-ff291c901f50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:49.128516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5637a2be-0890-4722-b76f-ff291c901f50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:49.129125 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5637a2be-0890-4722-b76f-ff291c901f50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:49.288714 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5637a2be-0890-4722-b76f-ff291c901f50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:49.296597 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5637a2be-0890-4722-b76f-ff291c901f50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.180859 Jun 28 12:06:49.297198 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 144/315] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:49 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:50.020047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4f65afae-7e53-42ed-9d80-0fbe8aa3dc58 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:50.020694 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4f65afae-7e53-42ed-9d80-0fbe8aa3dc58 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:50.023219 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=44 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:50.030369 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f65afae-7e53-42ed-9d80-0fbe8aa3dc58 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:50.030807 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f65afae-7e53-42ed-9d80-0fbe8aa3dc58 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:50.031580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f65afae-7e53-42ed-9d80-0fbe8aa3dc58 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:50.032015 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f65afae-7e53-42ed-9d80-0fbe8aa3dc58 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:50.166970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4f65afae-7e53-42ed-9d80-0fbe8aa3dc58 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:50.174899 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4f65afae-7e53-42ed-9d80-0fbe8aa3dc58 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.158715 Jun 28 12:06:50.175453 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 172/316] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:50 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:50.313712 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f735a3af-54be-4f62-bbcf-4ce54a43db71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:50.314325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f735a3af-54be-4f62-bbcf-4ce54a43db71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:50.320931 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f735a3af-54be-4f62-bbcf-4ce54a43db71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:50.321413 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f735a3af-54be-4f62-bbcf-4ce54a43db71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:50.322228 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f735a3af-54be-4f62-bbcf-4ce54a43db71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:50.322690 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f735a3af-54be-4f62-bbcf-4ce54a43db71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:50.462810 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f735a3af-54be-4f62-bbcf-4ce54a43db71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:50.467314 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:50.472974 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f735a3af-54be-4f62-bbcf-4ce54a43db71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.163142 Jun 28 12:06:50.473559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 145/317] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:50 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:51.200662 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0dccad26-808d-4421-a15a-47b02f07d808 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:51.202185 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0dccad26-808d-4421-a15a-47b02f07d808 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:51.211925 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0dccad26-808d-4421-a15a-47b02f07d808 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:51.212609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0dccad26-808d-4421-a15a-47b02f07d808 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:51.214178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0dccad26-808d-4421-a15a-47b02f07d808 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:51.214933 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0dccad26-808d-4421-a15a-47b02f07d808 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:51.356826 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0dccad26-808d-4421-a15a-47b02f07d808 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:51.365534 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0dccad26-808d-4421-a15a-47b02f07d808 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.173976 Jun 28 12:06:51.366096 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 173/318] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:51 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:51.495740 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-22d25e1b-415c-4020-a2bd-1715e4c0dfec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:51.496703 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-22d25e1b-415c-4020-a2bd-1715e4c0dfec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:51.508843 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22d25e1b-415c-4020-a2bd-1715e4c0dfec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:51.509634 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22d25e1b-415c-4020-a2bd-1715e4c0dfec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:51.510874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22d25e1b-415c-4020-a2bd-1715e4c0dfec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:51.511303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22d25e1b-415c-4020-a2bd-1715e4c0dfec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:51.648429 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-22d25e1b-415c-4020-a2bd-1715e4c0dfec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:51.659890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-22d25e1b-415c-4020-a2bd-1715e4c0dfec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.170407 Jun 28 12:06:51.660671 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 146/319] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:51 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:52.383593 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2a3c0df0-84be-48aa-8361-a2c299282a57 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:52.384232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2a3c0df0-84be-48aa-8361-a2c299282a57 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:52.391494 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a3c0df0-84be-48aa-8361-a2c299282a57 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:52.391934 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a3c0df0-84be-48aa-8361-a2c299282a57 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:52.392710 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a3c0df0-84be-48aa-8361-a2c299282a57 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:52.393196 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2a3c0df0-84be-48aa-8361-a2c299282a57 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:52.395743 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:52.532280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2a3c0df0-84be-48aa-8361-a2c299282a57 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:52.539760 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2a3c0df0-84be-48aa-8361-a2c299282a57 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.160252 Jun 28 12:06:52.540314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 174/320] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:52 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:52.677652 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0fa4d677-da3f-4b3f-9421-f3e627881901 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:52.678397 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0fa4d677-da3f-4b3f-9421-f3e627881901 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:52.686205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fa4d677-da3f-4b3f-9421-f3e627881901 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:52.686665 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fa4d677-da3f-4b3f-9421-f3e627881901 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:52.687446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fa4d677-da3f-4b3f-9421-f3e627881901 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:52.687885 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fa4d677-da3f-4b3f-9421-f3e627881901 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:52.831197 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0fa4d677-da3f-4b3f-9421-f3e627881901 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:52.839461 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0fa4d677-da3f-4b3f-9421-f3e627881901 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.166294 Jun 28 12:06:52.840026 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 147/321] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:52 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:53.559737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-18620045-3ae8-4595-92e3-baff9b356bc0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:53.560306 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-18620045-3ae8-4595-92e3-baff9b356bc0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:53.566998 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-18620045-3ae8-4595-92e3-baff9b356bc0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:53.567453 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-18620045-3ae8-4595-92e3-baff9b356bc0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:53.568211 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-18620045-3ae8-4595-92e3-baff9b356bc0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:53.568670 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-18620045-3ae8-4595-92e3-baff9b356bc0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:53.710422 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-18620045-3ae8-4595-92e3-baff9b356bc0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:53.718940 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-18620045-3ae8-4595-92e3-baff9b356bc0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.165082 Jun 28 12:06:53.719571 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 175/322] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:53 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:53.861782 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ed7db2a0-b7ec-40d4-bebb-03dc228e8c2e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:53.862400 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ed7db2a0-b7ec-40d4-bebb-03dc228e8c2e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:53.869356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed7db2a0-b7ec-40d4-bebb-03dc228e8c2e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:53.869818 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed7db2a0-b7ec-40d4-bebb-03dc228e8c2e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:53.870574 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed7db2a0-b7ec-40d4-bebb-03dc228e8c2e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:53.871015 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed7db2a0-b7ec-40d4-bebb-03dc228e8c2e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:54.012093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ed7db2a0-b7ec-40d4-bebb-03dc228e8c2e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:54.019951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ed7db2a0-b7ec-40d4-bebb-03dc228e8c2e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.162033 Jun 28 12:06:54.020717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 148/323] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:53 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:54.736530 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4f1db530-ba88-4861-a962-5101ad8c6281 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:54.737209 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4f1db530-ba88-4861-a962-5101ad8c6281 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:54.743514 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f1db530-ba88-4861-a962-5101ad8c6281 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:54.743963 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f1db530-ba88-4861-a962-5101ad8c6281 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:54.744731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f1db530-ba88-4861-a962-5101ad8c6281 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:54.745197 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4f1db530-ba88-4861-a962-5101ad8c6281 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:54.891661 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4f1db530-ba88-4861-a962-5101ad8c6281 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:54.903344 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4f1db530-ba88-4861-a962-5101ad8c6281 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.170456 Jun 28 12:06:54.903897 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 176/324] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:54 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:55.041211 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1a9920f6-1fd4-4075-85a2-1fdd74b5d525 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:55.042155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1a9920f6-1fd4-4075-85a2-1fdd74b5d525 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:55.053397 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a9920f6-1fd4-4075-85a2-1fdd74b5d525 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:55.054150 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a9920f6-1fd4-4075-85a2-1fdd74b5d525 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:55.055439 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a9920f6-1fd4-4075-85a2-1fdd74b5d525 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:55.056158 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a9920f6-1fd4-4075-85a2-1fdd74b5d525 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:55.197847 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1a9920f6-1fd4-4075-85a2-1fdd74b5d525 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:55.206593 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1a9920f6-1fd4-4075-85a2-1fdd74b5d525 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.171985 Jun 28 12:06:55.207026 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 149/325] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:55 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:55.920870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-874d1301-6983-4c9d-9571-44ca523770bd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:55.921520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-874d1301-6983-4c9d-9571-44ca523770bd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:55.928120 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-874d1301-6983-4c9d-9571-44ca523770bd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:55.928572 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-874d1301-6983-4c9d-9571-44ca523770bd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:55.929373 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-874d1301-6983-4c9d-9571-44ca523770bd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:55.929805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-874d1301-6983-4c9d-9571-44ca523770bd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:56.070326 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-874d1301-6983-4c9d-9571-44ca523770bd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:56.078350 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-874d1301-6983-4c9d-9571-44ca523770bd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.161514 Jun 28 12:06:56.078937 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 177/326] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:55 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:56.228128 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e96df8ab-c69f-42c6-b5db-45a72442571f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:56.229008 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e96df8ab-c69f-42c6-b5db-45a72442571f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:56.240216 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e96df8ab-c69f-42c6-b5db-45a72442571f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:56.240996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e96df8ab-c69f-42c6-b5db-45a72442571f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:56.242262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e96df8ab-c69f-42c6-b5db-45a72442571f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:56.242986 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e96df8ab-c69f-42c6-b5db-45a72442571f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:56.393624 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e96df8ab-c69f-42c6-b5db-45a72442571f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:56.401532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e96df8ab-c69f-42c6-b5db-45a72442571f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.180155 Jun 28 12:06:56.402080 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 150/327] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:56 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:57.101447 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f30cb710-de98-414c-bd00-c57e404cfdea tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:57.102555 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f30cb710-de98-414c-bd00-c57e404cfdea tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:57.113819 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f30cb710-de98-414c-bd00-c57e404cfdea tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:57.114570 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f30cb710-de98-414c-bd00-c57e404cfdea tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:57.115923 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f30cb710-de98-414c-bd00-c57e404cfdea tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:57.116553 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f30cb710-de98-414c-bd00-c57e404cfdea tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:57.256966 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f30cb710-de98-414c-bd00-c57e404cfdea tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:57.268699 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f30cb710-de98-414c-bd00-c57e404cfdea tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.173702 Jun 28 12:06:57.269617 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 178/328] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:57 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:57.421636 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4343fe83-59c5-4bbc-ba29-538cc0437e98 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:57.422265 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4343fe83-59c5-4bbc-ba29-538cc0437e98 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:57.424874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:57.431538 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4343fe83-59c5-4bbc-ba29-538cc0437e98 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:57.432069 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4343fe83-59c5-4bbc-ba29-538cc0437e98 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:57.432961 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4343fe83-59c5-4bbc-ba29-538cc0437e98 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:57.433501 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4343fe83-59c5-4bbc-ba29-538cc0437e98 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:57.589941 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4343fe83-59c5-4bbc-ba29-538cc0437e98 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:57.598346 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4343fe83-59c5-4bbc-ba29-538cc0437e98 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.182698 Jun 28 12:06:57.598906 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 151/329] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:57 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:58.290792 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a2cccf10-26a4-4aee-9d76-253592d444e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:58.291743 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a2cccf10-26a4-4aee-9d76-253592d444e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:58.299952 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2cccf10-26a4-4aee-9d76-253592d444e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:58.300371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2cccf10-26a4-4aee-9d76-253592d444e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:58.301162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2cccf10-26a4-4aee-9d76-253592d444e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:58.301586 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2cccf10-26a4-4aee-9d76-253592d444e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:58.452564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a2cccf10-26a4-4aee-9d76-253592d444e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:58.464973 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a2cccf10-26a4-4aee-9d76-253592d444e3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.180646 Jun 28 12:06:58.466397 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 179/330] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:58 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:58.619800 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-87eb70a3-a8f7-4812-b4a7-98359e0e1fc9 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:58.620894 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-87eb70a3-a8f7-4812-b4a7-98359e0e1fc9 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:58.628841 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87eb70a3-a8f7-4812-b4a7-98359e0e1fc9 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:58.629351 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87eb70a3-a8f7-4812-b4a7-98359e0e1fc9 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:58.630235 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87eb70a3-a8f7-4812-b4a7-98359e0e1fc9 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:58.630683 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87eb70a3-a8f7-4812-b4a7-98359e0e1fc9 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:58.779833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-87eb70a3-a8f7-4812-b4a7-98359e0e1fc9 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:58.788136 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-87eb70a3-a8f7-4812-b4a7-98359e0e1fc9 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.175099 Jun 28 12:06:58.788765 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 152/331] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:58 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:59.484839 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-dc6ab2ac-f45a-43c5-b8da-206d57604045 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:59.485468 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-dc6ab2ac-f45a-43c5-b8da-206d57604045 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:59.492075 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dc6ab2ac-f45a-43c5-b8da-206d57604045 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:59.492524 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dc6ab2ac-f45a-43c5-b8da-206d57604045 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:59.493329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dc6ab2ac-f45a-43c5-b8da-206d57604045 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:59.493792 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dc6ab2ac-f45a-43c5-b8da-206d57604045 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:59.651377 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dc6ab2ac-f45a-43c5-b8da-206d57604045 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:59.659346 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-dc6ab2ac-f45a-43c5-b8da-206d57604045 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.178946 Jun 28 12:06:59.659909 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 180/332] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:59 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:06:59.805068 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e1563eff-bc58-4a85-a769-b3857afc1b9b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:06:59.805679 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e1563eff-bc58-4a85-a769-b3857afc1b9b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:06:59.813171 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e1563eff-bc58-4a85-a769-b3857afc1b9b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:59.813765 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e1563eff-bc58-4a85-a769-b3857afc1b9b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:59.814397 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e1563eff-bc58-4a85-a769-b3857afc1b9b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:06:59.814841 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e1563eff-bc58-4a85-a769-b3857afc1b9b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:06:59.955627 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e1563eff-bc58-4a85-a769-b3857afc1b9b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:06:59.967321 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e1563eff-bc58-4a85-a769-b3857afc1b9b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.166201 Jun 28 12:06:59.967963 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 153/333] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:06:59 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:00.679864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-91770758-5846-4629-9d51-fa1978950e21 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:00.680443 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-91770758-5846-4629-9d51-fa1978950e21 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:00.688495 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-91770758-5846-4629-9d51-fa1978950e21 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:00.689028 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-91770758-5846-4629-9d51-fa1978950e21 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:00.689861 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-91770758-5846-4629-9d51-fa1978950e21 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:00.690330 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-91770758-5846-4629-9d51-fa1978950e21 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:00.828488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-91770758-5846-4629-9d51-fa1978950e21 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:00.836417 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-91770758-5846-4629-9d51-fa1978950e21 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1510 microversion: 2.1 time: 0.162867 Jun 28 12:07:00.837034 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 181/334] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:00 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:00.987833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-43144fc7-a774-4d21-bd7d-d56cf4577713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:00.988451 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-43144fc7-a774-4d21-bd7d-d56cf4577713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:00.997746 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43144fc7-a774-4d21-bd7d-d56cf4577713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:00.998201 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43144fc7-a774-4d21-bd7d-d56cf4577713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:00.998954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43144fc7-a774-4d21-bd7d-d56cf4577713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:00.999679 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43144fc7-a774-4d21-bd7d-d56cf4577713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:01.148835 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-43144fc7-a774-4d21-bd7d-d56cf4577713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:01.158784 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-43144fc7-a774-4d21-bd7d-d56cf4577713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.177389 Jun 28 12:07:01.159730 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 154/335] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:00 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:01.855723 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2f845136-8ae1-4e2f-9c84-e1020ddf8c4e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:01.856479 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2f845136-8ae1-4e2f-9c84-e1020ddf8c4e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:01.863345 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f845136-8ae1-4e2f-9c84-e1020ddf8c4e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:01.863776 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f845136-8ae1-4e2f-9c84-e1020ddf8c4e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:01.864539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f845136-8ae1-4e2f-9c84-e1020ddf8c4e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:01.864992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2f845136-8ae1-4e2f-9c84-e1020ddf8c4e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:02.003117 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2f845136-8ae1-4e2f-9c84-e1020ddf8c4e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:02.010918 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2f845136-8ae1-4e2f-9c84-e1020ddf8c4e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1516 microversion: 2.1 time: 0.159456 Jun 28 12:07:02.011480 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 182/336] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:01 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:02.177120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7b01f6b5-c785-46cc-b2d5-796496899186 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:02.178084 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7b01f6b5-c785-46cc-b2d5-796496899186 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:02.184824 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b01f6b5-c785-46cc-b2d5-796496899186 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:02.185398 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b01f6b5-c785-46cc-b2d5-796496899186 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:02.187216 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b01f6b5-c785-46cc-b2d5-796496899186 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:02.187930 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b01f6b5-c785-46cc-b2d5-796496899186 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:02.353632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7b01f6b5-c785-46cc-b2d5-796496899186 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:02.364068 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7b01f6b5-c785-46cc-b2d5-796496899186 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.191562 Jun 28 12:07:02.364648 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 155/337] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:02 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:03.381946 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-afd2d253-f589-4a69-b937-feca0dc59eb4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:03.383053 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-afd2d253-f589-4a69-b937-feca0dc59eb4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:03.390063 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-afd2d253-f589-4a69-b937-feca0dc59eb4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:03.390591 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-afd2d253-f589-4a69-b937-feca0dc59eb4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:03.391453 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-afd2d253-f589-4a69-b937-feca0dc59eb4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:03.391886 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-afd2d253-f589-4a69-b937-feca0dc59eb4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:03.527753 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-afd2d253-f589-4a69-b937-feca0dc59eb4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:03.535813 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-afd2d253-f589-4a69-b937-feca0dc59eb4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.157793 Jun 28 12:07:03.536451 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 183/338] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:03 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:04.552601 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-53645ee9-267d-45d2-a0dd-2f0db474f172 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:04.553185 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-53645ee9-267d-45d2-a0dd-2f0db474f172 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:04.559518 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53645ee9-267d-45d2-a0dd-2f0db474f172 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:04.559976 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53645ee9-267d-45d2-a0dd-2f0db474f172 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:04.560919 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53645ee9-267d-45d2-a0dd-2f0db474f172 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:04.561810 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53645ee9-267d-45d2-a0dd-2f0db474f172 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:04.710016 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-53645ee9-267d-45d2-a0dd-2f0db474f172 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:04.718455 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-53645ee9-267d-45d2-a0dd-2f0db474f172 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.169819 Jun 28 12:07:04.719013 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 156/339] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:04 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:05.735684 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eada2178-bd13-499e-976c-d63bb7ed5c16 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:05.736260 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eada2178-bd13-499e-976c-d63bb7ed5c16 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:05.744853 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eada2178-bd13-499e-976c-d63bb7ed5c16 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:05.745517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eada2178-bd13-499e-976c-d63bb7ed5c16 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:05.746465 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eada2178-bd13-499e-976c-d63bb7ed5c16 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:05.746890 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eada2178-bd13-499e-976c-d63bb7ed5c16 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:05.891642 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-eada2178-bd13-499e-976c-d63bb7ed5c16 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:05.903907 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-eada2178-bd13-499e-976c-d63bb7ed5c16 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.172177 Jun 28 12:07:05.904699 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 184/340] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:05 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:06.926431 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b19c6c39-22f3-4ff4-a6a4-3b4ff200bcb3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:06.927387 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b19c6c39-22f3-4ff4-a6a4-3b4ff200bcb3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:06.938204 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b19c6c39-22f3-4ff4-a6a4-3b4ff200bcb3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:06.938675 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b19c6c39-22f3-4ff4-a6a4-3b4ff200bcb3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:06.939409 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b19c6c39-22f3-4ff4-a6a4-3b4ff200bcb3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:06.939835 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b19c6c39-22f3-4ff4-a6a4-3b4ff200bcb3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:07.077571 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b19c6c39-22f3-4ff4-a6a4-3b4ff200bcb3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:07.085225 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b19c6c39-22f3-4ff4-a6a4-3b4ff200bcb3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.166276 Jun 28 12:07:07.085788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 157/341] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:06 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:08.102787 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8442021c-eb3c-414c-adbf-31da48831448 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:08.103371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8442021c-eb3c-414c-adbf-31da48831448 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:08.110138 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8442021c-eb3c-414c-adbf-31da48831448 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:08.110613 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8442021c-eb3c-414c-adbf-31da48831448 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:08.111408 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8442021c-eb3c-414c-adbf-31da48831448 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:08.111833 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8442021c-eb3c-414c-adbf-31da48831448 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:08.251810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8442021c-eb3c-414c-adbf-31da48831448 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:08.260872 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8442021c-eb3c-414c-adbf-31da48831448 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.161951 Jun 28 12:07:08.261594 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 185/342] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:08 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:08.693444 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8800064d-c3b3-4dcf-9985-97c5561f9851 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Action: 'create', calling method: .version_select at 0x7f3932e66ca0>, body: {"keypair": {"name": "tempest-keypair-754099897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiRchclHIaI1Irqub3TToha48CGvfY3bm0cD1J9TsfTj+OSBie3V8hdDoMpUW0qgqaFutELlFxqztIL2SEMN8+QziEBcGPWx1QHyhrtXxVi+kXD7jtLo13xl+mlUPbw3A=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:07:08.708558 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-8800064d-c3b3-4dcf-9985-97c5561f9851 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Getting quotas for project c47f35f9ae5e4a55be23a84e3887b915. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:07:08.712486 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-8800064d-c3b3-4dcf-9985-97c5561f9851 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Getting quotas for user 2a54e9db924c440da63c04052fe058e6 and project c47f35f9ae5e4a55be23a84e3887b915. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:07:08.742209 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8800064d-c3b3-4dcf-9985-97c5561f9851 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052650 Jun 28 12:07:08.748045 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 158/343] 10.222.0.55 () {60 vars in 1158 bytes} [Tue Jun 28 12:07:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:07:09.281704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a6954f9b-8b80-4ef4-ad62-835648efdf90 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:09.282531 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a6954f9b-8b80-4ef4-ad62-835648efdf90 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:09.289903 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6954f9b-8b80-4ef4-ad62-835648efdf90 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:09.290440 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6954f9b-8b80-4ef4-ad62-835648efdf90 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:09.291314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6954f9b-8b80-4ef4-ad62-835648efdf90 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:09.291835 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6954f9b-8b80-4ef4-ad62-835648efdf90 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:09.521269 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a6954f9b-8b80-4ef4-ad62-835648efdf90 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:09.533296 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a6954f9b-8b80-4ef4-ad62-835648efdf90 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.259112 Jun 28 12:07:09.534460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 186/344] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:09 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:10.117555 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-016f3cd1-036e-447c-b19e-4bb5445108f8 req-72e55347-99a3-4f53-8e06-aa7a7be5f90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3b43f9-d11c-431b-ae03-a6d4e7186040", "name": "network-vif-plugged", "status": "completed", "tag": "ff58ffa6-bb00-4617-a737-e6a53540ec91"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:07:10.130328 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-016f3cd1-036e-447c-b19e-4bb5445108f8 req-72e55347-99a3-4f53-8e06-aa7a7be5f90b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:10.131009 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-016f3cd1-036e-447c-b19e-4bb5445108f8 req-72e55347-99a3-4f53-8e06-aa7a7be5f90b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:10.146537 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-016f3cd1-036e-447c-b19e-4bb5445108f8 req-72e55347-99a3-4f53-8e06-aa7a7be5f90b service nova] Creating event network-vif-plugged:ff58ffa6-bb00-4617-a737-e6a53540ec91 for instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 on hv-cinder-84795 Jun 28 12:07:10.153139 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-016f3cd1-036e-447c-b19e-4bb5445108f8 req-72e55347-99a3-4f53-8e06-aa7a7be5f90b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039515 Jun 28 12:07:10.154515 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 159/345] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:07:10.185614 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-701436633", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53ee723f-205c-4be8-bee6-2b68e9be82de"}], "security_groups": [{"name": "tempest-securitygroup--1997104615"}], "key_name": "tempest-keypair-754099897", "user_data": "}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:07:10.292422 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] validate_networks() for [('53ee723f-205c-4be8-bee6-2b68e9be82de', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:07:10.553457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0f84aa6e-ae30-4f43-b922-02c7b2f1f810 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:10.554219 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0f84aa6e-ae30-4f43-b922-02c7b2f1f810 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:10.560712 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f84aa6e-ae30-4f43-b922-02c7b2f1f810 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:10.561267 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f84aa6e-ae30-4f43-b922-02c7b2f1f810 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:10.562144 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f84aa6e-ae30-4f43-b922-02c7b2f1f810 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:10.562597 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f84aa6e-ae30-4f43-b922-02c7b2f1f810 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:10.699553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0f84aa6e-ae30-4f43-b922-02c7b2f1f810 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:10.707998 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0f84aa6e-ae30-4f43-b922-02c7b2f1f810 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.160126 Jun 28 12:07:10.708568 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 160/346] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:10 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:07:10.761345 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:07:10.761887 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:07:10.762451 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:07:10.762861 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:07:10.763284 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:07:10.774096 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:10.774265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:10.775080 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:10.775505 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:10.792856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Getting quotas for project c47f35f9ae5e4a55be23a84e3887b915. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:07:10.796890 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Getting quotas for user 2a54e9db924c440da63c04052fe058e6 and project c47f35f9ae5e4a55be23a84e3887b915. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:07:10.808366 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:07:10.810797 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:07:10.870431 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-70e7a842-e873-40fd-a260-764b2860a3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.689089 Jun 28 12:07:10.871086 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 187/347] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:07:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:07:10.881377 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d52ee7e5-cf0e-40eb-9fa9-11968d7d5edd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:10.882027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d52ee7e5-cf0e-40eb-9fa9-11968d7d5edd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:10.938917 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d52ee7e5-cf0e-40eb-9fa9-11968d7d5edd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:10.946892 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d52ee7e5-cf0e-40eb-9fa9-11968d7d5edd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1244 microversion: 2.1 time: 0.069359 Jun 28 12:07:10.947481 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 161/348] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:10 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1244 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:07:11.726580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-974a5b10-a3ec-4273-bec8-c84b0b2d24d1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:11.727193 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-974a5b10-a3ec-4273-bec8-c84b0b2d24d1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:11.734055 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-974a5b10-a3ec-4273-bec8-c84b0b2d24d1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:11.734644 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-974a5b10-a3ec-4273-bec8-c84b0b2d24d1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:11.735664 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-974a5b10-a3ec-4273-bec8-c84b0b2d24d1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:11.736325 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-974a5b10-a3ec-4273-bec8-c84b0b2d24d1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:11.886902 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-974a5b10-a3ec-4273-bec8-c84b0b2d24d1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:11.895952 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-974a5b10-a3ec-4273-bec8-c84b0b2d24d1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1267 microversion: 2.1 time: 0.173295 Jun 28 12:07:11.896698 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 188/349] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:11 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:07:11.964545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-12ddf509-9a39-49cc-8d19-b16f598df0f4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:11.965532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-12ddf509-9a39-49cc-8d19-b16f598df0f4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:11.972973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12ddf509-9a39-49cc-8d19-b16f598df0f4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:11.973424 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12ddf509-9a39-49cc-8d19-b16f598df0f4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:11.974189 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12ddf509-9a39-49cc-8d19-b16f598df0f4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:11.974860 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-12ddf509-9a39-49cc-8d19-b16f598df0f4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:12.037714 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-12ddf509-9a39-49cc-8d19-b16f598df0f4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:12.045321 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-12ddf509-9a39-49cc-8d19-b16f598df0f4 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1240 microversion: 2.1 time: 0.084854 Jun 28 12:07:12.045886 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 162/350] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:11 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:12.912895 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fa02f3c9-af34-4a8e-ba90-83621c34b060 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:12.913552 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fa02f3c9-af34-4a8e-ba90-83621c34b060 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:12.919883 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa02f3c9-af34-4a8e-ba90-83621c34b060 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:12.920329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa02f3c9-af34-4a8e-ba90-83621c34b060 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:12.921157 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa02f3c9-af34-4a8e-ba90-83621c34b060 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:12.921604 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa02f3c9-af34-4a8e-ba90-83621c34b060 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:13.063161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-33a087a3-e4ea-4bac-ae7d-3b6a3fde494e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:13.064283 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-33a087a3-e4ea-4bac-ae7d-3b6a3fde494e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:13.072234 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33a087a3-e4ea-4bac-ae7d-3b6a3fde494e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:13.072674 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33a087a3-e4ea-4bac-ae7d-3b6a3fde494e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:13.073508 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33a087a3-e4ea-4bac-ae7d-3b6a3fde494e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:13.074094 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33a087a3-e4ea-4bac-ae7d-3b6a3fde494e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:13.153140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-33a087a3-e4ea-4bac-ae7d-3b6a3fde494e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:13.162014 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-33a087a3-e4ea-4bac-ae7d-3b6a3fde494e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1304 microversion: 2.1 time: 0.102769 Jun 28 12:07:13.162597 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 163/351] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:13 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:07:13.304624 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fa02f3c9-af34-4a8e-ba90-83621c34b060 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:13.312387 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fa02f3c9-af34-4a8e-ba90-83621c34b060 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1454 microversion: 2.1 time: 0.403392 Jun 28 12:07:13.313479 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 189/352] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:12 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1454 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:13.329908 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-24ce542a-1010-4616-a6e2-b3aa53d16312 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:13.330571 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-24ce542a-1010-4616-a6e2-b3aa53d16312 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:13.337351 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24ce542a-1010-4616-a6e2-b3aa53d16312 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:13.338185 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24ce542a-1010-4616-a6e2-b3aa53d16312 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:13.339150 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24ce542a-1010-4616-a6e2-b3aa53d16312 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:13.339603 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24ce542a-1010-4616-a6e2-b3aa53d16312 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:13.489912 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-24ce542a-1010-4616-a6e2-b3aa53d16312 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:13.497842 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-24ce542a-1010-4616-a6e2-b3aa53d16312 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1454 microversion: 2.1 time: 0.172079 Jun 28 12:07:13.498401 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 164/353] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:13 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:14.182686 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7ca4391d-e811-4305-8dd9-9414653ddc59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:14.183650 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7ca4391d-e811-4305-8dd9-9414653ddc59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:14.195689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ca4391d-e811-4305-8dd9-9414653ddc59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:14.196622 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ca4391d-e811-4305-8dd9-9414653ddc59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:14.198086 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ca4391d-e811-4305-8dd9-9414653ddc59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:14.198964 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7ca4391d-e811-4305-8dd9-9414653ddc59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:14.499708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7ca4391d-e811-4305-8dd9-9414653ddc59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:14.511716 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7ca4391d-e811-4305-8dd9-9414653ddc59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.333734 Jun 28 12:07:14.521594 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 190/354] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:14 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:15.129406 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-92246fa5-2c1b-44f5-9dbb-c904e33e326f req-cbadc02b-eeb7-4466-84b0-d2e201694e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820e4864-70b5-4a7e-bd0a-b33670b86066", "tag": "c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:07:15.145458 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-92246fa5-2c1b-44f5-9dbb-c904e33e326f req-cbadc02b-eeb7-4466-84b0-d2e201694e8f service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:15.147461 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-92246fa5-2c1b-44f5-9dbb-c904e33e326f req-cbadc02b-eeb7-4466-84b0-d2e201694e8f service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:15.157631 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:15.174477 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-92246fa5-2c1b-44f5-9dbb-c904e33e326f req-cbadc02b-eeb7-4466-84b0-d2e201694e8f service nova] Creating event network-changed:c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e for instance 820e4864-70b5-4a7e-bd0a-b33670b86066 on hv-cinder-84795 Jun 28 12:07:15.188118 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-92246fa5-2c1b-44f5-9dbb-c904e33e326f req-cbadc02b-eeb7-4466-84b0-d2e201694e8f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055032 Jun 28 12:07:15.190027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 165/355] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:07:15.529683 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-594074b4-b024-4e6a-b670-8a002d881116 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:15.531105 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-594074b4-b024-4e6a-b670-8a002d881116 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:15.539306 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-594074b4-b024-4e6a-b670-8a002d881116 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:15.539752 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-594074b4-b024-4e6a-b670-8a002d881116 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:15.540518 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-594074b4-b024-4e6a-b670-8a002d881116 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:15.541154 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-594074b4-b024-4e6a-b670-8a002d881116 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:15.558047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:15.817172 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-594074b4-b024-4e6a-b670-8a002d881116 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:15.825770 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-594074b4-b024-4e6a-b670-8a002d881116 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.300121 Jun 28 12:07:15.826537 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 191/356] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:15 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:16.078313 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-24348ceb-07a9-4309-a08e-7ebc676b6fe7 req-976e1410-c104-4f96-8ac2-7700f9aeffdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d3b43f9-d11c-431b-ae03-a6d4e7186040", "tag": "ff58ffa6-bb00-4617-a737-e6a53540ec91"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:07:16.095220 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-24348ceb-07a9-4309-a08e-7ebc676b6fe7 req-976e1410-c104-4f96-8ac2-7700f9aeffdb service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:16.095733 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-24348ceb-07a9-4309-a08e-7ebc676b6fe7 req-976e1410-c104-4f96-8ac2-7700f9aeffdb service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:16.121270 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-24348ceb-07a9-4309-a08e-7ebc676b6fe7 req-976e1410-c104-4f96-8ac2-7700f9aeffdb service nova] Creating event network-changed:ff58ffa6-bb00-4617-a737-e6a53540ec91 for instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 on hv-cinder-84795 Jun 28 12:07:16.127088 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-24348ceb-07a9-4309-a08e-7ebc676b6fe7 req-976e1410-c104-4f96-8ac2-7700f9aeffdb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053332 Jun 28 12:07:16.128052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 166/357] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:07:16.843316 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-61e17be5-24ac-487b-a3d9-e88d70507818 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:16.843926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-61e17be5-24ac-487b-a3d9-e88d70507818 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:16.850155 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61e17be5-24ac-487b-a3d9-e88d70507818 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:16.850602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61e17be5-24ac-487b-a3d9-e88d70507818 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:16.851364 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61e17be5-24ac-487b-a3d9-e88d70507818 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:16.851796 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61e17be5-24ac-487b-a3d9-e88d70507818 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:16.996321 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-61e17be5-24ac-487b-a3d9-e88d70507818 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:17.005673 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-61e17be5-24ac-487b-a3d9-e88d70507818 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.166504 Jun 28 12:07:17.006284 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 192/358] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:16 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:18.024969 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-837f33c4-744d-42cd-b96c-7a1d24ea5727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:18.025708 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-837f33c4-744d-42cd-b96c-7a1d24ea5727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:18.032251 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-837f33c4-744d-42cd-b96c-7a1d24ea5727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:18.033058 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-837f33c4-744d-42cd-b96c-7a1d24ea5727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:18.033726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-837f33c4-744d-42cd-b96c-7a1d24ea5727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:18.034181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-837f33c4-744d-42cd-b96c-7a1d24ea5727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:18.200120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-837f33c4-744d-42cd-b96c-7a1d24ea5727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:18.209124 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-837f33c4-744d-42cd-b96c-7a1d24ea5727 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.188959 Jun 28 12:07:18.212712 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 167/359] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:18 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:19.238941 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2d4914ae-63bb-451c-8962-b46997cf39d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:19.243221 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2d4914ae-63bb-451c-8962-b46997cf39d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:19.262053 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d4914ae-63bb-451c-8962-b46997cf39d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:19.263349 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d4914ae-63bb-451c-8962-b46997cf39d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:19.271854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d4914ae-63bb-451c-8962-b46997cf39d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:19.272439 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d4914ae-63bb-451c-8962-b46997cf39d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:19.446165 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2d4914ae-63bb-451c-8962-b46997cf39d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:19.471505 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2d4914ae-63bb-451c-8962-b46997cf39d0 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.243469 Jun 28 12:07:19.472997 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 193/360] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:19 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:20.489349 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2d7f85a5-be1e-43c3-8183-b4bb63e13e92 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:20.490008 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2d7f85a5-be1e-43c3-8183-b4bb63e13e92 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:20.496750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d7f85a5-be1e-43c3-8183-b4bb63e13e92 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:20.497273 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d7f85a5-be1e-43c3-8183-b4bb63e13e92 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:20.498300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d7f85a5-be1e-43c3-8183-b4bb63e13e92 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:20.498758 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2d7f85a5-be1e-43c3-8183-b4bb63e13e92 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:20.694296 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2d7f85a5-be1e-43c3-8183-b4bb63e13e92 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:20.702009 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2d7f85a5-be1e-43c3-8183-b4bb63e13e92 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.216892 Jun 28 12:07:20.702833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 168/361] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:20 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:21.719846 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3643fc1c-818c-467c-8e87-0eff9e3eb55a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:21.721063 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3643fc1c-818c-467c-8e87-0eff9e3eb55a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:21.726748 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:21.727721 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:21.733545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:21.736246 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3643fc1c-818c-467c-8e87-0eff9e3eb55a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:21.736699 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3643fc1c-818c-467c-8e87-0eff9e3eb55a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:21.737627 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3643fc1c-818c-467c-8e87-0eff9e3eb55a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:21.738378 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3643fc1c-818c-467c-8e87-0eff9e3eb55a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:21.969466 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3643fc1c-818c-467c-8e87-0eff9e3eb55a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:21.977977 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3643fc1c-818c-467c-8e87-0eff9e3eb55a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.262022 Jun 28 12:07:21.978832 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 194/362] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:21 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:23.000261 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f62da7c7-24a4-4d30-962d-541b03895fc9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:23.001134 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f62da7c7-24a4-4d30-962d-541b03895fc9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:23.010924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:23.016248 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f62da7c7-24a4-4d30-962d-541b03895fc9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:23.017102 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f62da7c7-24a4-4d30-962d-541b03895fc9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:23.018190 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f62da7c7-24a4-4d30-962d-541b03895fc9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:23.018782 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f62da7c7-24a4-4d30-962d-541b03895fc9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:23.208621 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f62da7c7-24a4-4d30-962d-541b03895fc9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:23.236689 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f62da7c7-24a4-4d30-962d-541b03895fc9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.242045 Jun 28 12:07:23.238069 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 169/363] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:22 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:24.254682 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-46a8897e-fe9d-4541-a4ff-a56812a8038a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:24.255520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-46a8897e-fe9d-4541-a4ff-a56812a8038a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:24.272633 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-46a8897e-fe9d-4541-a4ff-a56812a8038a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:24.274240 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-46a8897e-fe9d-4541-a4ff-a56812a8038a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:24.276768 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-46a8897e-fe9d-4541-a4ff-a56812a8038a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:24.277985 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-46a8897e-fe9d-4541-a4ff-a56812a8038a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:24.505340 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-46a8897e-fe9d-4541-a4ff-a56812a8038a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:24.521212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-46a8897e-fe9d-4541-a4ff-a56812a8038a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.270183 Jun 28 12:07:24.522126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 195/364] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:24 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:25.543432 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2eaab7ca-5609-4a02-9f99-86382735cced tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:25.545660 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2eaab7ca-5609-4a02-9f99-86382735cced tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:25.611798 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2eaab7ca-5609-4a02-9f99-86382735cced tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:25.615315 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2eaab7ca-5609-4a02-9f99-86382735cced tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:25.617346 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2eaab7ca-5609-4a02-9f99-86382735cced tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:25.621970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2eaab7ca-5609-4a02-9f99-86382735cced tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:26.030102 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2eaab7ca-5609-4a02-9f99-86382735cced tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:26.038688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2eaab7ca-5609-4a02-9f99-86382735cced tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.503243 Jun 28 12:07:26.045642 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 170/365] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:25 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:27.066662 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fa7da762-6bcc-4785-bb02-dc51e2b1b822 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:27.067418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fa7da762-6bcc-4785-bb02-dc51e2b1b822 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:27.074385 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa7da762-6bcc-4785-bb02-dc51e2b1b822 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:27.075059 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa7da762-6bcc-4785-bb02-dc51e2b1b822 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:27.075995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa7da762-6bcc-4785-bb02-dc51e2b1b822 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:27.076435 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa7da762-6bcc-4785-bb02-dc51e2b1b822 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:27.314493 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fa7da762-6bcc-4785-bb02-dc51e2b1b822 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:27.361399 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fa7da762-6bcc-4785-bb02-dc51e2b1b822 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.298742 Jun 28 12:07:27.361989 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 196/366] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:27 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:07:28.381475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9c8a84a4-e71d-4d37-ba7e-a40922218c09 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:28.383005 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9c8a84a4-e71d-4d37-ba7e-a40922218c09 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:28.393687 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:28.396200 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c8a84a4-e71d-4d37-ba7e-a40922218c09 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:28.397355 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c8a84a4-e71d-4d37-ba7e-a40922218c09 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:28.399873 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c8a84a4-e71d-4d37-ba7e-a40922218c09 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:28.400637 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9c8a84a4-e71d-4d37-ba7e-a40922218c09 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:28.629369 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9c8a84a4-e71d-4d37-ba7e-a40922218c09 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:28.642144 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9c8a84a4-e71d-4d37-ba7e-a40922218c09 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.265552 Jun 28 12:07:28.644536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 171/367] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:28 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:29.019115 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-68f00fc5-5936-4668-a93e-7cbed5d72b45 req-30fa23ec-ff56-411a-9650-bbd2c6fdd3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820e4864-70b5-4a7e-bd0a-b33670b86066", "name": "network-vif-plugged", "status": "completed", "tag": "c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:07:29.034338 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-68f00fc5-5936-4668-a93e-7cbed5d72b45 req-30fa23ec-ff56-411a-9650-bbd2c6fdd3e7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:29.035319 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-68f00fc5-5936-4668-a93e-7cbed5d72b45 req-30fa23ec-ff56-411a-9650-bbd2c6fdd3e7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:29.057921 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-68f00fc5-5936-4668-a93e-7cbed5d72b45 req-30fa23ec-ff56-411a-9650-bbd2c6fdd3e7 service nova] Creating event network-vif-plugged:c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e for instance 820e4864-70b5-4a7e-bd0a-b33670b86066 on hv-cinder-84795 Jun 28 12:07:29.064801 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-68f00fc5-5936-4668-a93e-7cbed5d72b45 req-30fa23ec-ff56-411a-9650-bbd2c6fdd3e7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050153 Jun 28 12:07:29.066558 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 197/368] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:07:29.661347 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fcfdd39d-f4df-4549-a99b-50f4a2d58859 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:29.662662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fcfdd39d-f4df-4549-a99b-50f4a2d58859 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:29.674225 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcfdd39d-f4df-4549-a99b-50f4a2d58859 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:29.674686 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcfdd39d-f4df-4549-a99b-50f4a2d58859 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:29.676095 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcfdd39d-f4df-4549-a99b-50f4a2d58859 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:29.678379 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fcfdd39d-f4df-4549-a99b-50f4a2d58859 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:30.004733 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fcfdd39d-f4df-4549-a99b-50f4a2d58859 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:30.015041 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fcfdd39d-f4df-4549-a99b-50f4a2d58859 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.357680 Jun 28 12:07:30.015944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 172/369] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:29 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:31.034842 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-467c8dd4-0bd0-426c-bb57-b3c76b363b59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:31.049337 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-467c8dd4-0bd0-426c-bb57-b3c76b363b59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:31.057426 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-467c8dd4-0bd0-426c-bb57-b3c76b363b59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:31.058317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-467c8dd4-0bd0-426c-bb57-b3c76b363b59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:31.059892 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-467c8dd4-0bd0-426c-bb57-b3c76b363b59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:31.060549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-467c8dd4-0bd0-426c-bb57-b3c76b363b59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:31.312936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-467c8dd4-0bd0-426c-bb57-b3c76b363b59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:31.322385 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-467c8dd4-0bd0-426c-bb57-b3c76b363b59 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1370 microversion: 2.1 time: 0.292834 Jun 28 12:07:31.323696 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 198/370] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:31 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:32.340030 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b661a0a3-f0a9-48a6-81cf-b9d6969f5e13 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:32.340637 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b661a0a3-f0a9-48a6-81cf-b9d6969f5e13 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:32.353791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b661a0a3-f0a9-48a6-81cf-b9d6969f5e13 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:32.354238 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b661a0a3-f0a9-48a6-81cf-b9d6969f5e13 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:32.355009 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b661a0a3-f0a9-48a6-81cf-b9d6969f5e13 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:32.355444 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b661a0a3-f0a9-48a6-81cf-b9d6969f5e13 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:32.554472 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b661a0a3-f0a9-48a6-81cf-b9d6969f5e13 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:32.568644 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b661a0a3-f0a9-48a6-81cf-b9d6969f5e13 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1565 microversion: 2.1 time: 0.232762 Jun 28 12:07:32.569440 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 173/371] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:32 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1565 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:32.585954 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0550c687-ebc7-44b7-a9b3-08e2941b926f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:32.590623 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0550c687-ebc7-44b7-a9b3-08e2941b926f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:32.598045 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0550c687-ebc7-44b7-a9b3-08e2941b926f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:32.598748 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0550c687-ebc7-44b7-a9b3-08e2941b926f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:32.599888 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0550c687-ebc7-44b7-a9b3-08e2941b926f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:32.600465 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0550c687-ebc7-44b7-a9b3-08e2941b926f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:32.716752 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0550c687-ebc7-44b7-a9b3-08e2941b926f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134610 Jun 28 12:07:32.723627 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 199/372] 10.222.0.55 () {58 vars in 1274 bytes} [Tue Jun 28 12:07:32 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:07:34.633710 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-27508ee1-c0e7-4e0d-a079-64e86c18b5df req-316d9358-a56d-411b-8756-f597490be185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820e4864-70b5-4a7e-bd0a-b33670b86066", "tag": "c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:07:34.644416 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-27508ee1-c0e7-4e0d-a079-64e86c18b5df req-316d9358-a56d-411b-8756-f597490be185 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:34.645083 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-27508ee1-c0e7-4e0d-a079-64e86c18b5df req-316d9358-a56d-411b-8756-f597490be185 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:34.664718 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-27508ee1-c0e7-4e0d-a079-64e86c18b5df req-316d9358-a56d-411b-8756-f597490be185 service nova] Creating event network-changed:c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e for instance 820e4864-70b5-4a7e-bd0a-b33670b86066 on hv-cinder-84795 Jun 28 12:07:34.670833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-27508ee1-c0e7-4e0d-a079-64e86c18b5df req-316d9358-a56d-411b-8756-f597490be185 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044410 Jun 28 12:07:34.675326 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 174/373] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:07:39.658738 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-177c22dc-ddf8-4098-99b3-eed5d4c42236 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Action: 'create', calling method: .version_select at 0x7f3932f1fca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-933171235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPtGadQIxavM+1xnq3UlSdqgo7HoEj1VYezWjfdbvo2uNGRr9PfpniADZNorZ1/O8pbraAfJ8H5rt4nCvOxoG1JOjcKLtY08eWs/g2G/F1Tz/04bj9FZtoKQNx+97cwjA=="}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:07:39.674364 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-177c22dc-ddf8-4098-99b3-eed5d4c42236 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Getting quotas for project 734fc82eeb014ad7b7bdb1c09236d44b. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:07:39.678767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-177c22dc-ddf8-4098-99b3-eed5d4c42236 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Getting quotas for user a9728aa79bb04cf58ea266102a3a5119 and project 734fc82eeb014ad7b7bdb1c09236d44b. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:07:39.691306 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR oslo.messaging._drivers.impl_rabbit [None req-177c22dc-ddf8-4098-99b3-eed5d4c42236 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [7f2efd58-9314-47b6-9c15-16c5a2b747b1] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 28 12:07:40.698753 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [None req-177c22dc-ddf8-4098-99b3-eed5d4c42236 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [7f2efd58-9314-47b6-9c15-16c5a2b747b1] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 34914. Jun 28 12:07:40.716277 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-177c22dc-ddf8-4098-99b3-eed5d4c42236 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.061921 Jun 28 12:07:40.716872 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 200/374] 10.222.0.55 () {60 vars in 1158 bytes} [Tue Jun 28 12:07:39 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:07:40.828965 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1533241761", "imageRef": "42f6ac9c-6e40-49be-8064-e3abcb88241e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-933171235", "networks": [{"uuid": "c13cb14f-5d95-473a-a0ad-ac3a0a5f4f37"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:07:40.883051 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] validate_networks() for [('c13cb14f-5d95-473a-a0ad-ac3a0a5f4f37', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:07:41.263534 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:07:41.264026 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:07:41.264558 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:07:41.265030 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:07:41.265437 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:07:41.274556 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:41.274994 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:41.275811 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:41.276317 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:41.295079 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Getting quotas for project 734fc82eeb014ad7b7bdb1c09236d44b. Resources: {'cores', 'ram', 'instances'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:07:41.299152 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Getting quotas for user a9728aa79bb04cf58ea266102a3a5119 and project 734fc82eeb014ad7b7bdb1c09236d44b. Resources: {'cores', 'ram', 'instances'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:07:41.311228 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:07:41.313451 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42f6ac9c-6e40-49be-8064-e3abcb88241e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:07:41.358266 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f48670b3-e506-4eed-992e-24d4507a8306 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534240 Jun 28 12:07:41.363832 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 175/375] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:07:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 28 12:07:41.369047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-954f705f-2a86-4e05-a95b-de12d032777e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:41.369757 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-954f705f-2a86-4e05-a95b-de12d032777e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:41.436427 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-954f705f-2a86-4e05-a95b-de12d032777e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:41.445467 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-954f705f-2a86-4e05-a95b-de12d032777e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1258 microversion: 2.1 time: 0.080314 Jun 28 12:07:41.446037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 201/376] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:41 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:42.465350 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-02916b76-4c05-4688-afb6-41d6286a94d0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:42.466711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-02916b76-4c05-4688-afb6-41d6286a94d0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:42.477816 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02916b76-4c05-4688-afb6-41d6286a94d0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:42.478755 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02916b76-4c05-4688-afb6-41d6286a94d0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:42.480203 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02916b76-4c05-4688-afb6-41d6286a94d0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:42.480813 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02916b76-4c05-4688-afb6-41d6286a94d0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:42.551613 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-02916b76-4c05-4688-afb6-41d6286a94d0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:42.562083 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-02916b76-4c05-4688-afb6-41d6286a94d0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1310 microversion: 2.1 time: 0.102078 Jun 28 12:07:42.563188 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 176/377] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:42 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:43.584136 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b95c2b56-f297-486c-a229-99dd13d92165 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:43.584891 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b95c2b56-f297-486c-a229-99dd13d92165 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:43.592017 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=45 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:43.607432 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b95c2b56-f297-486c-a229-99dd13d92165 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:43.607824 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b95c2b56-f297-486c-a229-99dd13d92165 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:43.608823 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b95c2b56-f297-486c-a229-99dd13d92165 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:43.609317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b95c2b56-f297-486c-a229-99dd13d92165 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:43.845408 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b95c2b56-f297-486c-a229-99dd13d92165 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:43.854846 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b95c2b56-f297-486c-a229-99dd13d92165 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.276911 Jun 28 12:07:43.855948 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 202/378] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:43 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:44.874343 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0fe2f2fb-2ab3-4df3-8be0-185dbf4ee332 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:44.874911 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0fe2f2fb-2ab3-4df3-8be0-185dbf4ee332 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:44.882248 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fe2f2fb-2ab3-4df3-8be0-185dbf4ee332 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:44.882706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fe2f2fb-2ab3-4df3-8be0-185dbf4ee332 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:44.883492 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fe2f2fb-2ab3-4df3-8be0-185dbf4ee332 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:44.883893 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0fe2f2fb-2ab3-4df3-8be0-185dbf4ee332 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:45.028669 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0fe2f2fb-2ab3-4df3-8be0-185dbf4ee332 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:45.036693 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0fe2f2fb-2ab3-4df3-8be0-185dbf4ee332 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.166311 Jun 28 12:07:45.037289 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 177/379] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:44 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:07:45.390023 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1138653394", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:07:45.440305 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] validate_networks() for None {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:07:45.740000 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:07:45.740412 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:07:45.740888 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:07:45.741315 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:07:45.741719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:07:45.751918 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:45.752391 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:45.753211 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:45.753658 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:45.775627 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Getting quotas for project 171326d56d234a3d90bc61643b76f113. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:07:45.779853 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Getting quotas for user b8358ccdda51447d8372602b27f43095 and project 171326d56d234a3d90bc61643b76f113. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:07:45.791380 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:07:45.793778 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:07:45.840477 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b52183c5-1c6c-47c1-8e06-9b51be4fa878 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.454317 Jun 28 12:07:45.846170 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 203/380] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:07:45.851345 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-37686f17-e834-4958-bb38-d2e9e2114715 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:45.851961 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-37686f17-e834-4958-bb38-d2e9e2114715 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:45.918013 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-37686f17-e834-4958-bb38-d2e9e2114715 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:45.931663 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-37686f17-e834-4958-bb38-d2e9e2114715 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1215 microversion: 2.1 time: 0.084127 Jun 28 12:07:45.932255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 178/381] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:45 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:46.055268 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-49cd81eb-7094-4594-afb8-c783ec0ca841 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:46.056298 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-49cd81eb-7094-4594-afb8-c783ec0ca841 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:46.063718 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-49cd81eb-7094-4594-afb8-c783ec0ca841 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:46.064166 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-49cd81eb-7094-4594-afb8-c783ec0ca841 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:46.065120 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-49cd81eb-7094-4594-afb8-c783ec0ca841 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:46.065668 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-49cd81eb-7094-4594-afb8-c783ec0ca841 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:46.277040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-49cd81eb-7094-4594-afb8-c783ec0ca841 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:46.280938 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-49cd81eb-7094-4594-afb8-c783ec0ca841 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.231019 Jun 28 12:07:46.281718 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 204/382] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:46 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:46.952686 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-711fc563-24f3-44d8-a6e6-2b4870fed887 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:46.953312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-711fc563-24f3-44d8-a6e6-2b4870fed887 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:46.961352 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-711fc563-24f3-44d8-a6e6-2b4870fed887 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:46.961826 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-711fc563-24f3-44d8-a6e6-2b4870fed887 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:46.962641 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-711fc563-24f3-44d8-a6e6-2b4870fed887 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:46.963081 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-711fc563-24f3-44d8-a6e6-2b4870fed887 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:46.966543 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=61 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:47.046514 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-711fc563-24f3-44d8-a6e6-2b4870fed887 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:47.056248 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-711fc563-24f3-44d8-a6e6-2b4870fed887 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.107264 Jun 28 12:07:47.056916 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 179/383] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:46 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:47.299070 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-addb3958-ff68-41e7-838d-5ada7617c712 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:47.299752 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-addb3958-ff68-41e7-838d-5ada7617c712 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:47.307051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-addb3958-ff68-41e7-838d-5ada7617c712 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:47.307567 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-addb3958-ff68-41e7-838d-5ada7617c712 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:47.308400 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-addb3958-ff68-41e7-838d-5ada7617c712 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:47.308856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-addb3958-ff68-41e7-838d-5ada7617c712 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:47.468185 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-addb3958-ff68-41e7-838d-5ada7617c712 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:47.476646 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-addb3958-ff68-41e7-838d-5ada7617c712 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.182198 Jun 28 12:07:47.477443 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 205/384] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:47 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:48.073592 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eb35c2c1-aea1-47f1-b685-d3baf841ea15 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:48.074308 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eb35c2c1-aea1-47f1-b685-d3baf841ea15 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:48.081497 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb35c2c1-aea1-47f1-b685-d3baf841ea15 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:48.081996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb35c2c1-aea1-47f1-b685-d3baf841ea15 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:48.082842 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb35c2c1-aea1-47f1-b685-d3baf841ea15 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:48.083260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb35c2c1-aea1-47f1-b685-d3baf841ea15 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:48.149477 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eb35c2c1-aea1-47f1-b685-d3baf841ea15 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:48.157089 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eb35c2c1-aea1-47f1-b685-d3baf841ea15 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.087391 Jun 28 12:07:48.157652 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 180/385] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:48 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:48.497968 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a14cfce7-bef4-49ba-b9cb-2e281c5809a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:48.498916 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a14cfce7-bef4-49ba-b9cb-2e281c5809a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:48.507505 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a14cfce7-bef4-49ba-b9cb-2e281c5809a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:48.507951 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a14cfce7-bef4-49ba-b9cb-2e281c5809a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:48.508709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a14cfce7-bef4-49ba-b9cb-2e281c5809a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:48.509181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a14cfce7-bef4-49ba-b9cb-2e281c5809a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:48.654894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a14cfce7-bef4-49ba-b9cb-2e281c5809a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:48.662916 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a14cfce7-bef4-49ba-b9cb-2e281c5809a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.171454 Jun 28 12:07:48.663458 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 206/386] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:48 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:49.174632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e45ad277-924d-42cc-a1a8-1ce72c727529 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:49.175274 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e45ad277-924d-42cc-a1a8-1ce72c727529 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:49.182137 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e45ad277-924d-42cc-a1a8-1ce72c727529 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:49.182585 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e45ad277-924d-42cc-a1a8-1ce72c727529 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:49.183570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e45ad277-924d-42cc-a1a8-1ce72c727529 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:49.184202 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e45ad277-924d-42cc-a1a8-1ce72c727529 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:49.257500 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e45ad277-924d-42cc-a1a8-1ce72c727529 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:49.265651 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e45ad277-924d-42cc-a1a8-1ce72c727529 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.095080 Jun 28 12:07:49.266415 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 181/387] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:49 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:49.680464 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b5362dd4-f37a-4963-ad00-ee23208bc1d3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:49.681129 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b5362dd4-f37a-4963-ad00-ee23208bc1d3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:49.687723 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b5362dd4-f37a-4963-ad00-ee23208bc1d3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:49.688082 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b5362dd4-f37a-4963-ad00-ee23208bc1d3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:49.688842 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b5362dd4-f37a-4963-ad00-ee23208bc1d3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:49.689389 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b5362dd4-f37a-4963-ad00-ee23208bc1d3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:49.825543 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b5362dd4-f37a-4963-ad00-ee23208bc1d3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:49.833655 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b5362dd4-f37a-4963-ad00-ee23208bc1d3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.156751 Jun 28 12:07:49.834221 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 207/388] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:49 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:50.283268 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0c3e9db2-d66f-41dc-99f2-ef7f3e40bf04 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:50.283910 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0c3e9db2-d66f-41dc-99f2-ef7f3e40bf04 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:50.290594 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c3e9db2-d66f-41dc-99f2-ef7f3e40bf04 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:50.291037 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c3e9db2-d66f-41dc-99f2-ef7f3e40bf04 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:50.291795 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c3e9db2-d66f-41dc-99f2-ef7f3e40bf04 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:50.292222 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c3e9db2-d66f-41dc-99f2-ef7f3e40bf04 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:50.362428 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0c3e9db2-d66f-41dc-99f2-ef7f3e40bf04 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:50.370347 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0c3e9db2-d66f-41dc-99f2-ef7f3e40bf04 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.091014 Jun 28 12:07:50.371217 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 182/389] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:50 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:50.851008 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-61de59cb-c7de-454e-b714-37e3b7ed93e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:50.851603 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-61de59cb-c7de-454e-b714-37e3b7ed93e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:50.858142 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61de59cb-c7de-454e-b714-37e3b7ed93e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:50.858585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61de59cb-c7de-454e-b714-37e3b7ed93e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:50.859348 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61de59cb-c7de-454e-b714-37e3b7ed93e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:50.859780 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-61de59cb-c7de-454e-b714-37e3b7ed93e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:51.001621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-61de59cb-c7de-454e-b714-37e3b7ed93e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:51.010073 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-61de59cb-c7de-454e-b714-37e3b7ed93e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.163125 Jun 28 12:07:51.020570 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 208/390] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:50 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:51.387925 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0eb3f104-ca9a-49ea-85d4-097761a875c5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:51.388578 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0eb3f104-ca9a-49ea-85d4-097761a875c5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:51.390502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:51.397764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0eb3f104-ca9a-49ea-85d4-097761a875c5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:51.397980 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0eb3f104-ca9a-49ea-85d4-097761a875c5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:51.398736 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0eb3f104-ca9a-49ea-85d4-097761a875c5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:51.399175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0eb3f104-ca9a-49ea-85d4-097761a875c5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:51.468119 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0eb3f104-ca9a-49ea-85d4-097761a875c5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:51.479759 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0eb3f104-ca9a-49ea-85d4-097761a875c5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.095705 Jun 28 12:07:51.480769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 183/391] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:51 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:52.027853 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-27e2b2f6-b449-4713-991e-2b1e09818c18 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:52.028724 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-27e2b2f6-b449-4713-991e-2b1e09818c18 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:52.030741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:52.036724 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-27e2b2f6-b449-4713-991e-2b1e09818c18 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:52.037288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-27e2b2f6-b449-4713-991e-2b1e09818c18 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:52.038088 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-27e2b2f6-b449-4713-991e-2b1e09818c18 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:52.038564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-27e2b2f6-b449-4713-991e-2b1e09818c18 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:52.176505 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-27e2b2f6-b449-4713-991e-2b1e09818c18 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:52.186282 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-27e2b2f6-b449-4713-991e-2b1e09818c18 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.162578 Jun 28 12:07:52.186856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 209/392] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:52 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:52.498281 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ff75f647-42d5-4f79-8f7c-755a1b5ae7d5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:52.498949 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ff75f647-42d5-4f79-8f7c-755a1b5ae7d5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:52.505841 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff75f647-42d5-4f79-8f7c-755a1b5ae7d5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:52.506295 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff75f647-42d5-4f79-8f7c-755a1b5ae7d5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:52.507060 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff75f647-42d5-4f79-8f7c-755a1b5ae7d5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:52.507496 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff75f647-42d5-4f79-8f7c-755a1b5ae7d5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:52.807494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ff75f647-42d5-4f79-8f7c-755a1b5ae7d5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:52.815459 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ff75f647-42d5-4f79-8f7c-755a1b5ae7d5 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.321050 Jun 28 12:07:52.816050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 184/393] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:52 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:53.218380 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a64c6519-8d06-43c8-9c00-08b5a6fa724c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:53.219022 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a64c6519-8d06-43c8-9c00-08b5a6fa724c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:53.230621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a64c6519-8d06-43c8-9c00-08b5a6fa724c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:53.231055 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a64c6519-8d06-43c8-9c00-08b5a6fa724c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:53.231826 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a64c6519-8d06-43c8-9c00-08b5a6fa724c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:53.232253 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a64c6519-8d06-43c8-9c00-08b5a6fa724c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:53.365429 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a64c6519-8d06-43c8-9c00-08b5a6fa724c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:53.373563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a64c6519-8d06-43c8-9c00-08b5a6fa724c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.172312 Jun 28 12:07:53.374169 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 210/394] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:53 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:53.832132 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6e2ad284-13e2-4804-b354-ee8667f2e060 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:53.833827 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6e2ad284-13e2-4804-b354-ee8667f2e060 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:53.842079 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e2ad284-13e2-4804-b354-ee8667f2e060 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:53.842527 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e2ad284-13e2-4804-b354-ee8667f2e060 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:53.843574 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e2ad284-13e2-4804-b354-ee8667f2e060 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:53.844014 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e2ad284-13e2-4804-b354-ee8667f2e060 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:53.909235 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6e2ad284-13e2-4804-b354-ee8667f2e060 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:53.917441 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6e2ad284-13e2-4804-b354-ee8667f2e060 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.089278 Jun 28 12:07:53.918013 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 185/395] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:53 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:54.391630 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-642ab6ac-8467-4117-b85b-a74425393bd7 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:54.392242 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-642ab6ac-8467-4117-b85b-a74425393bd7 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:54.398825 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-642ab6ac-8467-4117-b85b-a74425393bd7 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:54.399467 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-642ab6ac-8467-4117-b85b-a74425393bd7 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:54.400442 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-642ab6ac-8467-4117-b85b-a74425393bd7 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:54.400887 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-642ab6ac-8467-4117-b85b-a74425393bd7 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:54.539305 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-642ab6ac-8467-4117-b85b-a74425393bd7 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:54.547600 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-642ab6ac-8467-4117-b85b-a74425393bd7 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.160097 Jun 28 12:07:54.548295 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 211/396] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:54 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:54.935662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3f3e087b-8d88-4094-8f50-130c63bafd90 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:54.936227 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3f3e087b-8d88-4094-8f50-130c63bafd90 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:54.943262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f3e087b-8d88-4094-8f50-130c63bafd90 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:54.943711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f3e087b-8d88-4094-8f50-130c63bafd90 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:54.944483 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f3e087b-8d88-4094-8f50-130c63bafd90 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:54.944931 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3f3e087b-8d88-4094-8f50-130c63bafd90 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:55.010719 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3f3e087b-8d88-4094-8f50-130c63bafd90 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:55.018654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3f3e087b-8d88-4094-8f50-130c63bafd90 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.087166 Jun 28 12:07:55.019222 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 186/397] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:54 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:55.566089 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2e0900b3-643f-4a2a-a69a-d0a749899029 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:55.566711 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2e0900b3-643f-4a2a-a69a-d0a749899029 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:55.573432 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2e0900b3-643f-4a2a-a69a-d0a749899029 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:55.573635 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2e0900b3-643f-4a2a-a69a-d0a749899029 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:55.574319 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2e0900b3-643f-4a2a-a69a-d0a749899029 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:55.574768 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2e0900b3-643f-4a2a-a69a-d0a749899029 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:55.709573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2e0900b3-643f-4a2a-a69a-d0a749899029 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:55.718597 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2e0900b3-643f-4a2a-a69a-d0a749899029 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.156587 Jun 28 12:07:55.719395 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 212/398] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:55 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:56.036565 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-378350b3-14ed-402a-b821-27fb239bc3a0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:56.037269 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-378350b3-14ed-402a-b821-27fb239bc3a0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:56.039048 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=8 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:56.045240 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-378350b3-14ed-402a-b821-27fb239bc3a0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:56.045683 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-378350b3-14ed-402a-b821-27fb239bc3a0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:56.046429 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-378350b3-14ed-402a-b821-27fb239bc3a0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:56.046862 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-378350b3-14ed-402a-b821-27fb239bc3a0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:56.118304 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-378350b3-14ed-402a-b821-27fb239bc3a0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:56.126397 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-378350b3-14ed-402a-b821-27fb239bc3a0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.093700 Jun 28 12:07:56.126954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 187/399] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:56 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:56.735900 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-60dc73c9-51c4-4ddb-aaf8-51229715ac91 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:56.736807 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-60dc73c9-51c4-4ddb-aaf8-51229715ac91 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:56.739118 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:56.740148 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=12 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:56.747731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-60dc73c9-51c4-4ddb-aaf8-51229715ac91 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:56.748181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-60dc73c9-51c4-4ddb-aaf8-51229715ac91 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:56.748979 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-60dc73c9-51c4-4ddb-aaf8-51229715ac91 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:56.749416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-60dc73c9-51c4-4ddb-aaf8-51229715ac91 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:56.887762 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-60dc73c9-51c4-4ddb-aaf8-51229715ac91 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:56.895563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-60dc73c9-51c4-4ddb-aaf8-51229715ac91 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.163640 Jun 28 12:07:56.896126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 213/400] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:56 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:57.144052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3eb59202-723e-4782-a190-762a442d2fa7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:57.144781 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3eb59202-723e-4782-a190-762a442d2fa7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:57.151937 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3eb59202-723e-4782-a190-762a442d2fa7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:57.152397 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3eb59202-723e-4782-a190-762a442d2fa7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:57.153195 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3eb59202-723e-4782-a190-762a442d2fa7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:57.153623 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3eb59202-723e-4782-a190-762a442d2fa7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:57.220531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3eb59202-723e-4782-a190-762a442d2fa7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:57.228490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3eb59202-723e-4782-a190-762a442d2fa7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.088725 Jun 28 12:07:57.229139 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 188/401] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:57 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:57.913838 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-33b74db7-deba-48f2-ad17-c8694779c589 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:57.914506 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-33b74db7-deba-48f2-ad17-c8694779c589 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:57.920785 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33b74db7-deba-48f2-ad17-c8694779c589 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:57.921276 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33b74db7-deba-48f2-ad17-c8694779c589 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:57.922050 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33b74db7-deba-48f2-ad17-c8694779c589 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:57.922498 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33b74db7-deba-48f2-ad17-c8694779c589 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:58.069257 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-33b74db7-deba-48f2-ad17-c8694779c589 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:58.077112 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-33b74db7-deba-48f2-ad17-c8694779c589 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.167927 Jun 28 12:07:58.077684 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 214/402] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:57 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:58.246397 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ff581ad0-dcd3-4906-8589-b3b0bc218a47 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:58.247010 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ff581ad0-dcd3-4906-8589-b3b0bc218a47 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:58.253750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff581ad0-dcd3-4906-8589-b3b0bc218a47 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:58.254206 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff581ad0-dcd3-4906-8589-b3b0bc218a47 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:58.254971 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff581ad0-dcd3-4906-8589-b3b0bc218a47 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:58.255407 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ff581ad0-dcd3-4906-8589-b3b0bc218a47 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:58.318534 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ff581ad0-dcd3-4906-8589-b3b0bc218a47 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:58.326200 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ff581ad0-dcd3-4906-8589-b3b0bc218a47 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.084429 Jun 28 12:07:58.326764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 189/403] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:58 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:59.094581 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7129965-99f1-4ab3-9aaa-f0620c4f72c5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:59.095111 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a7129965-99f1-4ab3-9aaa-f0620c4f72c5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:59.101636 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7129965-99f1-4ab3-9aaa-f0620c4f72c5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:59.102088 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7129965-99f1-4ab3-9aaa-f0620c4f72c5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:59.102825 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7129965-99f1-4ab3-9aaa-f0620c4f72c5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:59.103295 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7129965-99f1-4ab3-9aaa-f0620c4f72c5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:59.243284 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a7129965-99f1-4ab3-9aaa-f0620c4f72c5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:59.251034 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a7129965-99f1-4ab3-9aaa-f0620c4f72c5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.160531 Jun 28 12:07:59.251621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 215/404] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:59 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:59.345350 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-79d15b65-7c80-4c2a-9c2c-189ce0978406 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:07:59.348480 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-79d15b65-7c80-4c2a-9c2c-189ce0978406 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:07:59.352386 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:59.358780 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79d15b65-7c80-4c2a-9c2c-189ce0978406 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:59.359580 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79d15b65-7c80-4c2a-9c2c-189ce0978406 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:59.360341 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79d15b65-7c80-4c2a-9c2c-189ce0978406 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:59.360781 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79d15b65-7c80-4c2a-9c2c-189ce0978406 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:07:59.428173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-79d15b65-7c80-4c2a-9c2c-189ce0978406 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:07:59.435973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-79d15b65-7c80-4c2a-9c2c-189ce0978406 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1219 microversion: 2.1 time: 0.095606 Jun 28 12:07:59.438025 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 190/405] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:07:59 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:07:59.975627 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-0b65f2ff-2e86-4610-a2b0-4e53041a4513 req-de6ad7da-afac-4c58-b7f9-000d5243c664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583b6c67-8700-4030-953d-58678d33b913", "tag": "d4c7a854-153d-4c80-a397-448ffe963bca"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:07:59.990213 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-0b65f2ff-2e86-4610-a2b0-4e53041a4513 req-de6ad7da-afac-4c58-b7f9-000d5243c664 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:07:59.990845 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-0b65f2ff-2e86-4610-a2b0-4e53041a4513 req-de6ad7da-afac-4c58-b7f9-000d5243c664 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:00.003353 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-0b65f2ff-2e86-4610-a2b0-4e53041a4513 req-de6ad7da-afac-4c58-b7f9-000d5243c664 service nova] Creating event network-changed:d4c7a854-153d-4c80-a397-448ffe963bca for instance 583b6c67-8700-4030-953d-58678d33b913 on hv-cinder-84795 Jun 28 12:08:00.013672 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-0b65f2ff-2e86-4610-a2b0-4e53041a4513 req-de6ad7da-afac-4c58-b7f9-000d5243c664 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041577 Jun 28 12:08:00.014186 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 216/406] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:08:00.268702 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8814b7e0-e66e-46b7-8560-91c86724dc58 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:00.269326 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8814b7e0-e66e-46b7-8560-91c86724dc58 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:00.276886 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8814b7e0-e66e-46b7-8560-91c86724dc58 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:00.277516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8814b7e0-e66e-46b7-8560-91c86724dc58 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:00.279046 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8814b7e0-e66e-46b7-8560-91c86724dc58 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:00.279480 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8814b7e0-e66e-46b7-8560-91c86724dc58 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:00.425254 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8814b7e0-e66e-46b7-8560-91c86724dc58 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:00.433504 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8814b7e0-e66e-46b7-8560-91c86724dc58 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.168846 Jun 28 12:08:00.434153 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 191/407] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:00 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:00.452785 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-323a343e-89a4-40fe-902f-3bfd3f7f67d0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:00.453701 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-323a343e-89a4-40fe-902f-3bfd3f7f67d0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:00.460547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-323a343e-89a4-40fe-902f-3bfd3f7f67d0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:00.461017 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-323a343e-89a4-40fe-902f-3bfd3f7f67d0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:00.461782 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-323a343e-89a4-40fe-902f-3bfd3f7f67d0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:00.462208 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-323a343e-89a4-40fe-902f-3bfd3f7f67d0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:00.548199 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-323a343e-89a4-40fe-902f-3bfd3f7f67d0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:00.555974 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-323a343e-89a4-40fe-902f-3bfd3f7f67d0 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1273 microversion: 2.1 time: 0.107437 Jun 28 12:08:00.556535 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 217/408] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:00 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:01.450931 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-aab26013-e8a8-4fae-a7bb-195443e5f82e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:01.452207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-aab26013-e8a8-4fae-a7bb-195443e5f82e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:01.459507 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aab26013-e8a8-4fae-a7bb-195443e5f82e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:01.460263 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aab26013-e8a8-4fae-a7bb-195443e5f82e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:01.461086 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aab26013-e8a8-4fae-a7bb-195443e5f82e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:01.461518 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aab26013-e8a8-4fae-a7bb-195443e5f82e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:01.574248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-887877c2-9fab-463e-a94d-58e12cbe8722 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:01.574942 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-887877c2-9fab-463e-a94d-58e12cbe8722 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:01.581182 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-887877c2-9fab-463e-a94d-58e12cbe8722 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:01.581640 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-887877c2-9fab-463e-a94d-58e12cbe8722 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:01.582430 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-887877c2-9fab-463e-a94d-58e12cbe8722 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:01.582862 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-887877c2-9fab-463e-a94d-58e12cbe8722 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:01.608356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-aab26013-e8a8-4fae-a7bb-195443e5f82e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:01.616840 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-aab26013-e8a8-4fae-a7bb-195443e5f82e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.170599 Jun 28 12:08:01.623079 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 192/409] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:01 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:01.719744 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-887877c2-9fab-463e-a94d-58e12cbe8722 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:01.728074 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-887877c2-9fab-463e-a94d-58e12cbe8722 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.158005 Jun 28 12:08:01.728642 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 218/410] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:01 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:02.634699 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2694b4ce-0c63-47a9-9421-c2721b46ed62 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:02.635342 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2694b4ce-0c63-47a9-9421-c2721b46ed62 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:02.642588 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2694b4ce-0c63-47a9-9421-c2721b46ed62 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:02.643036 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2694b4ce-0c63-47a9-9421-c2721b46ed62 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:02.643788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2694b4ce-0c63-47a9-9421-c2721b46ed62 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:02.644232 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2694b4ce-0c63-47a9-9421-c2721b46ed62 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:02.745229 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7d59a39e-c74f-4349-9baf-1bb10308e594 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:02.745801 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7d59a39e-c74f-4349-9baf-1bb10308e594 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:02.753092 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d59a39e-c74f-4349-9baf-1bb10308e594 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:02.753549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d59a39e-c74f-4349-9baf-1bb10308e594 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:02.754334 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d59a39e-c74f-4349-9baf-1bb10308e594 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:02.754772 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d59a39e-c74f-4349-9baf-1bb10308e594 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:02.786572 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2694b4ce-0c63-47a9-9421-c2721b46ed62 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:02.793072 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2694b4ce-0c63-47a9-9421-c2721b46ed62 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.162205 Jun 28 12:08:02.793643 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 193/411] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:02 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:02.898018 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7d59a39e-c74f-4349-9baf-1bb10308e594 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:02.901534 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:02.906882 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7d59a39e-c74f-4349-9baf-1bb10308e594 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.165586 Jun 28 12:08:02.907450 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 219/412] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:02 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:03.810306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-04372859-9906-4a67-ad16-8b6ea11d8749 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:03.810893 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-04372859-9906-4a67-ad16-8b6ea11d8749 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:03.818103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04372859-9906-4a67-ad16-8b6ea11d8749 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:03.818558 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04372859-9906-4a67-ad16-8b6ea11d8749 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:03.819311 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04372859-9906-4a67-ad16-8b6ea11d8749 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:03.819776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04372859-9906-4a67-ad16-8b6ea11d8749 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:03.923829 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7bae31db-c68d-48e1-b65f-423f12e13ccd tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:03.924699 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7bae31db-c68d-48e1-b65f-423f12e13ccd tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:03.931385 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bae31db-c68d-48e1-b65f-423f12e13ccd tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:03.931803 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bae31db-c68d-48e1-b65f-423f12e13ccd tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:03.932596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bae31db-c68d-48e1-b65f-423f12e13ccd tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:03.933056 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bae31db-c68d-48e1-b65f-423f12e13ccd tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:03.959823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-04372859-9906-4a67-ad16-8b6ea11d8749 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:03.967912 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-04372859-9906-4a67-ad16-8b6ea11d8749 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.161542 Jun 28 12:08:03.968514 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 194/413] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:03 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:04.066288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7bae31db-c68d-48e1-b65f-423f12e13ccd tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:04.073986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7bae31db-c68d-48e1-b65f-423f12e13ccd tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.154140 Jun 28 12:08:04.074558 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 220/414] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:03 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:08:04.986184 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ffc07566-22f1-4a51-bc9f-3f9a0f8e4380 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:04.987474 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ffc07566-22f1-4a51-bc9f-3f9a0f8e4380 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:04.994572 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffc07566-22f1-4a51-bc9f-3f9a0f8e4380 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:04.995287 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffc07566-22f1-4a51-bc9f-3f9a0f8e4380 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:04.996406 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffc07566-22f1-4a51-bc9f-3f9a0f8e4380 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:04.996920 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffc07566-22f1-4a51-bc9f-3f9a0f8e4380 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:05.092652 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-68f629ee-f0cf-4efa-a776-a30737d98b39 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:05.094155 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-68f629ee-f0cf-4efa-a776-a30737d98b39 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:05.110695 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68f629ee-f0cf-4efa-a776-a30737d98b39 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:05.112777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68f629ee-f0cf-4efa-a776-a30737d98b39 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:05.113841 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68f629ee-f0cf-4efa-a776-a30737d98b39 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:05.114780 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-68f629ee-f0cf-4efa-a776-a30737d98b39 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:05.174570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ffc07566-22f1-4a51-bc9f-3f9a0f8e4380 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:05.176781 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:05.191163 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ffc07566-22f1-4a51-bc9f-3f9a0f8e4380 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.209371 Jun 28 12:08:05.212778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 195/415] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:04 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:05.398737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-68f629ee-f0cf-4efa-a776-a30737d98b39 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:05.406602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-68f629ee-f0cf-4efa-a776-a30737d98b39 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.319382 Jun 28 12:08:05.407923 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 221/416] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:05 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:05.530439 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-ff7f20f8-c52e-4464-8a91-23b930c9bdf7 req-0cfdc13b-11a3-43ab-a434-3b42993c8663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d8c6a7-184f-4b76-b28b-47e5e69357f4", "tag": "53c721c9-2e6b-4d36-a8f1-f413d7ce762a"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:05.543667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ff7f20f8-c52e-4464-8a91-23b930c9bdf7 req-0cfdc13b-11a3-43ab-a434-3b42993c8663 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:05.544120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ff7f20f8-c52e-4464-8a91-23b930c9bdf7 req-0cfdc13b-11a3-43ab-a434-3b42993c8663 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:05.558200 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-ff7f20f8-c52e-4464-8a91-23b930c9bdf7 req-0cfdc13b-11a3-43ab-a434-3b42993c8663 service nova] Creating event network-changed:53c721c9-2e6b-4d36-a8f1-f413d7ce762a for instance a6d8c6a7-184f-4b76-b28b-47e5e69357f4 on hv-cinder-84795 Jun 28 12:08:05.564095 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-ff7f20f8-c52e-4464-8a91-23b930c9bdf7 req-0cfdc13b-11a3-43ab-a434-3b42993c8663 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052915 Jun 28 12:08:05.564665 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 196/417] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:08:06.208303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5f69ab06-9ebf-4184-902c-5a8e6f3aec78 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:06.208955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5f69ab06-9ebf-4184-902c-5a8e6f3aec78 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:06.215916 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f69ab06-9ebf-4184-902c-5a8e6f3aec78 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:06.216353 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f69ab06-9ebf-4184-902c-5a8e6f3aec78 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:06.217155 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f69ab06-9ebf-4184-902c-5a8e6f3aec78 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:06.217583 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f69ab06-9ebf-4184-902c-5a8e6f3aec78 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:06.359768 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5f69ab06-9ebf-4184-902c-5a8e6f3aec78 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:06.367582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5f69ab06-9ebf-4184-902c-5a8e6f3aec78 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.163660 Jun 28 12:08:06.368165 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 222/418] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:06 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:06.427895 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c1365177-4999-464d-9057-3af0385537da tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:06.428615 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c1365177-4999-464d-9057-3af0385537da tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:06.436439 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1365177-4999-464d-9057-3af0385537da tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:06.436879 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1365177-4999-464d-9057-3af0385537da tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:06.437678 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1365177-4999-464d-9057-3af0385537da tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:06.438500 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1365177-4999-464d-9057-3af0385537da tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:06.580838 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c1365177-4999-464d-9057-3af0385537da tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:06.588393 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c1365177-4999-464d-9057-3af0385537da tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.166221 Jun 28 12:08:06.589319 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 197/419] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:06 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:07.388160 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b21621c9-ba17-4bba-8705-eb1563b94e72 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:07.388812 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b21621c9-ba17-4bba-8705-eb1563b94e72 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:07.395695 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b21621c9-ba17-4bba-8705-eb1563b94e72 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:07.396135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b21621c9-ba17-4bba-8705-eb1563b94e72 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:07.396918 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b21621c9-ba17-4bba-8705-eb1563b94e72 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:07.397373 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b21621c9-ba17-4bba-8705-eb1563b94e72 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:07.541969 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b21621c9-ba17-4bba-8705-eb1563b94e72 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:07.549605 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b21621c9-ba17-4bba-8705-eb1563b94e72 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.165626 Jun 28 12:08:07.550160 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 223/420] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:07 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:07.606160 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d2198b6f-4b45-422b-a56c-f71b653b7a55 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:07.606746 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d2198b6f-4b45-422b-a56c-f71b653b7a55 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:07.614189 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2198b6f-4b45-422b-a56c-f71b653b7a55 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:07.614631 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2198b6f-4b45-422b-a56c-f71b653b7a55 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:07.615662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2198b6f-4b45-422b-a56c-f71b653b7a55 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:07.616165 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2198b6f-4b45-422b-a56c-f71b653b7a55 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:07.760486 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2198b6f-4b45-422b-a56c-f71b653b7a55 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:07.769616 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d2198b6f-4b45-422b-a56c-f71b653b7a55 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.167313 Jun 28 12:08:07.770153 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 198/421] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:07 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:07.908972 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-abc01638-08f0-48d9-af4d-f89d0862614e req-91e119a2-83d1-4920-962c-5f00d4333c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583b6c67-8700-4030-953d-58678d33b913", "name": "network-vif-plugged", "status": "completed", "tag": "d4c7a854-153d-4c80-a397-448ffe963bca"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:07.917332 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-abc01638-08f0-48d9-af4d-f89d0862614e req-91e119a2-83d1-4920-962c-5f00d4333c8e service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:07.917819 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-abc01638-08f0-48d9-af4d-f89d0862614e req-91e119a2-83d1-4920-962c-5f00d4333c8e service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:07.930263 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-abc01638-08f0-48d9-af4d-f89d0862614e req-91e119a2-83d1-4920-962c-5f00d4333c8e service nova] Creating event network-vif-plugged:d4c7a854-153d-4c80-a397-448ffe963bca for instance 583b6c67-8700-4030-953d-58678d33b913 on hv-cinder-84795 Jun 28 12:08:07.935716 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-abc01638-08f0-48d9-af4d-f89d0862614e req-91e119a2-83d1-4920-962c-5f00d4333c8e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030471 Jun 28 12:08:07.936502 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 224/422] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:08:08.566883 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-79c0d0c7-b337-43ce-b0ac-e56e16ccef1c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:08.567751 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-79c0d0c7-b337-43ce-b0ac-e56e16ccef1c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:08.574205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79c0d0c7-b337-43ce-b0ac-e56e16ccef1c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:08.574661 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79c0d0c7-b337-43ce-b0ac-e56e16ccef1c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:08.575415 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79c0d0c7-b337-43ce-b0ac-e56e16ccef1c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:08.575816 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79c0d0c7-b337-43ce-b0ac-e56e16ccef1c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:08.722251 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-79c0d0c7-b337-43ce-b0ac-e56e16ccef1c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:08.740026 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-79c0d0c7-b337-43ce-b0ac-e56e16ccef1c tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.176989 Jun 28 12:08:08.740809 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 199/423] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:08 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:08.788825 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e5db5f13-f59e-4d62-aabf-cb41273c7978 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:08.789654 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e5db5f13-f59e-4d62-aabf-cb41273c7978 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:08.799461 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e5db5f13-f59e-4d62-aabf-cb41273c7978 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:08.800085 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e5db5f13-f59e-4d62-aabf-cb41273c7978 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:08.801220 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e5db5f13-f59e-4d62-aabf-cb41273c7978 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:08.801827 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e5db5f13-f59e-4d62-aabf-cb41273c7978 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:08.935947 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e5db5f13-f59e-4d62-aabf-cb41273c7978 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:08.945795 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e5db5f13-f59e-4d62-aabf-cb41273c7978 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.161839 Jun 28 12:08:08.946482 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 225/424] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:08 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:09.759793 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1b812780-ea5e-4aec-828a-0dbc947e3e3d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:09.761085 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1b812780-ea5e-4aec-828a-0dbc947e3e3d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:09.768929 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b812780-ea5e-4aec-828a-0dbc947e3e3d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:09.769633 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b812780-ea5e-4aec-828a-0dbc947e3e3d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:09.770580 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b812780-ea5e-4aec-828a-0dbc947e3e3d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:09.771015 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b812780-ea5e-4aec-828a-0dbc947e3e3d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:09.913475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1b812780-ea5e-4aec-828a-0dbc947e3e3d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:09.921053 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1b812780-ea5e-4aec-828a-0dbc947e3e3d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.165243 Jun 28 12:08:09.921631 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 200/425] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:09 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:09.967044 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-58c21340-3b5c-4372-a1c4-147c585ce455 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:09.967646 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-58c21340-3b5c-4372-a1c4-147c585ce455 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:09.974392 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-58c21340-3b5c-4372-a1c4-147c585ce455 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:09.974838 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-58c21340-3b5c-4372-a1c4-147c585ce455 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:09.975592 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-58c21340-3b5c-4372-a1c4-147c585ce455 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:09.976020 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-58c21340-3b5c-4372-a1c4-147c585ce455 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:10.161442 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-58c21340-3b5c-4372-a1c4-147c585ce455 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:10.174283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-58c21340-3b5c-4372-a1c4-147c585ce455 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.211128 Jun 28 12:08:10.174847 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 226/426] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:09 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:10.938893 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-860552ba-78a8-405c-9993-49842d468c40 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:10.939472 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-860552ba-78a8-405c-9993-49842d468c40 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:10.946975 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-860552ba-78a8-405c-9993-49842d468c40 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:10.947391 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-860552ba-78a8-405c-9993-49842d468c40 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:10.948140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-860552ba-78a8-405c-9993-49842d468c40 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:10.948567 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-860552ba-78a8-405c-9993-49842d468c40 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:11.088207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-860552ba-78a8-405c-9993-49842d468c40 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:11.096451 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-860552ba-78a8-405c-9993-49842d468c40 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.161417 Jun 28 12:08:11.097445 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 201/427] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:10 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:11.191509 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a0e9ec57-80a0-4a67-a578-4a3664fda5d1 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:11.192126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a0e9ec57-80a0-4a67-a578-4a3664fda5d1 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:11.198609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0e9ec57-80a0-4a67-a578-4a3664fda5d1 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:11.199053 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0e9ec57-80a0-4a67-a578-4a3664fda5d1 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:11.199844 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0e9ec57-80a0-4a67-a578-4a3664fda5d1 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:11.200242 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a0e9ec57-80a0-4a67-a578-4a3664fda5d1 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:11.408101 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a0e9ec57-80a0-4a67-a578-4a3664fda5d1 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:11.416484 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a0e9ec57-80a0-4a67-a578-4a3664fda5d1 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.229056 Jun 28 12:08:11.417089 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 227/428] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:11 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:12.114632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e742cd9a-3cc6-4671-aec8-4ca54535d3a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:12.115268 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e742cd9a-3cc6-4671-aec8-4ca54535d3a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:12.122256 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e742cd9a-3cc6-4671-aec8-4ca54535d3a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:12.122697 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e742cd9a-3cc6-4671-aec8-4ca54535d3a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:12.123451 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e742cd9a-3cc6-4671-aec8-4ca54535d3a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:12.123883 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e742cd9a-3cc6-4671-aec8-4ca54535d3a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:12.259207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e742cd9a-3cc6-4671-aec8-4ca54535d3a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:12.267153 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e742cd9a-3cc6-4671-aec8-4ca54535d3a5 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1358 microversion: 2.1 time: 0.156889 Jun 28 12:08:12.267863 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 202/429] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:12 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:12.444399 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-366bb743-76c7-4352-a380-49b90fc93c36 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:12.445138 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-366bb743-76c7-4352-a380-49b90fc93c36 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:12.456964 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-366bb743-76c7-4352-a380-49b90fc93c36 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:12.457704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-366bb743-76c7-4352-a380-49b90fc93c36 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:12.458625 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-366bb743-76c7-4352-a380-49b90fc93c36 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:12.459198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-366bb743-76c7-4352-a380-49b90fc93c36 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:12.595798 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-366bb743-76c7-4352-a380-49b90fc93c36 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:12.604260 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-366bb743-76c7-4352-a380-49b90fc93c36 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.164541 Jun 28 12:08:12.605004 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 228/430] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:12 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:13.284730 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9ddfa879-3909-4a7e-907a-a87055173849 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:13.285364 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9ddfa879-3909-4a7e-907a-a87055173849 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:13.292263 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ddfa879-3909-4a7e-907a-a87055173849 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:13.292705 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ddfa879-3909-4a7e-907a-a87055173849 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:13.293493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ddfa879-3909-4a7e-907a-a87055173849 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:13.293919 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ddfa879-3909-4a7e-907a-a87055173849 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:13.424934 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9ddfa879-3909-4a7e-907a-a87055173849 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:13.432741 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9ddfa879-3909-4a7e-907a-a87055173849 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1549 microversion: 2.1 time: 0.152060 Jun 28 12:08:13.433345 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 203/431] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:13 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:13.450177 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e557f7b3-1793-472e-9e7f-9b36c8cfbe60 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:13.450787 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e557f7b3-1793-472e-9e7f-9b36c8cfbe60 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:13.457414 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e557f7b3-1793-472e-9e7f-9b36c8cfbe60 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:13.457856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e557f7b3-1793-472e-9e7f-9b36c8cfbe60 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:13.458612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e557f7b3-1793-472e-9e7f-9b36c8cfbe60 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:13.459043 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e557f7b3-1793-472e-9e7f-9b36c8cfbe60 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:13.592427 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e557f7b3-1793-472e-9e7f-9b36c8cfbe60 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:13.600645 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e557f7b3-1793-472e-9e7f-9b36c8cfbe60 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1549 microversion: 2.1 time: 0.154312 Jun 28 12:08:13.601267 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 229/432] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:13 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:13.617350 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dce2fbb7-1741-4628-9fb1-cb165b0a5063 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:13.620762 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dce2fbb7-1741-4628-9fb1-cb165b0a5063 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:13.620953 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5829d1b0-18aa-49d1-912d-c8c07f8bd5a4 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:13.621454 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5829d1b0-18aa-49d1-912d-c8c07f8bd5a4 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:13.621596 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dce2fbb7-1741-4628-9fb1-cb165b0a5063 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Searching by: {'deleted': False, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b'} {{(pid=117889) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 28 12:08:13.628672 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce2fbb7-1741-4628-9fb1-cb165b0a5063 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:13.628874 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5829d1b0-18aa-49d1-912d-c8c07f8bd5a4 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:13.629155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce2fbb7-1741-4628-9fb1-cb165b0a5063 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:13.629319 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5829d1b0-18aa-49d1-912d-c8c07f8bd5a4 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:13.629938 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5829d1b0-18aa-49d1-912d-c8c07f8bd5a4 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:13.630077 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce2fbb7-1741-4628-9fb1-cb165b0a5063 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:13.630366 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5829d1b0-18aa-49d1-912d-c8c07f8bd5a4 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:13.630527 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce2fbb7-1741-4628-9fb1-cb165b0a5063 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:13.719554 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.multi_cell_list [None req-dce2fbb7-1741-4628-9fb1-cb165b0a5063 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117889) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 28 12:08:13.775074 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5829d1b0-18aa-49d1-912d-c8c07f8bd5a4 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:13.786649 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5829d1b0-18aa-49d1-912d-c8c07f8bd5a4 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.169437 Jun 28 12:08:13.788161 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 230/433] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:13 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:13.841276 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dce2fbb7-1741-4628-9fb1-cb165b0a5063 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227857 Jun 28 12:08:13.841780 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 204/434] 10.222.0.55 () {58 vars in 1124 bytes} [Tue Jun 28 12:08:13 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:08:13.854904 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cc39777e-3946-4879-b626-31763ccfbee0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:13.855506 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cc39777e-3946-4879-b626-31763ccfbee0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:13.862726 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc39777e-3946-4879-b626-31763ccfbee0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:13.863169 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc39777e-3946-4879-b626-31763ccfbee0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:13.863910 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc39777e-3946-4879-b626-31763ccfbee0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:13.864331 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cc39777e-3946-4879-b626-31763ccfbee0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:13.995898 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cc39777e-3946-4879-b626-31763ccfbee0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:14.006118 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cc39777e-3946-4879-b626-31763ccfbee0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1549 microversion: 2.1 time: 0.154806 Jun 28 12:08:14.006949 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 231/435] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:13 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:08:14.307557 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-21284cbb-bb09-47c9-9c3b-24551cfde3a3 req-61a97fbd-27ce-4ae3-b0e7-5681bc502aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d8c6a7-184f-4b76-b28b-47e5e69357f4", "name": "network-vif-plugged", "status": "completed", "tag": "53c721c9-2e6b-4d36-a8f1-f413d7ce762a"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:14.319761 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-21284cbb-bb09-47c9-9c3b-24551cfde3a3 req-61a97fbd-27ce-4ae3-b0e7-5681bc502aac service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:14.320470 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-21284cbb-bb09-47c9-9c3b-24551cfde3a3 req-61a97fbd-27ce-4ae3-b0e7-5681bc502aac service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:14.336848 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-21284cbb-bb09-47c9-9c3b-24551cfde3a3 req-61a97fbd-27ce-4ae3-b0e7-5681bc502aac service nova] Creating event network-vif-plugged:53c721c9-2e6b-4d36-a8f1-f413d7ce762a for instance a6d8c6a7-184f-4b76-b28b-47e5e69357f4 on hv-cinder-84795 Jun 28 12:08:14.342717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-21284cbb-bb09-47c9-9c3b-24551cfde3a3 req-61a97fbd-27ce-4ae3-b0e7-5681bc502aac service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040254 Jun 28 12:08:14.344079 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 205/436] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:08:14.804962 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4abd8054-01c2-417f-9b96-99c0bc9dbf83 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:14.805607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4abd8054-01c2-417f-9b96-99c0bc9dbf83 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:14.812203 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4abd8054-01c2-417f-9b96-99c0bc9dbf83 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:14.812649 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4abd8054-01c2-417f-9b96-99c0bc9dbf83 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:14.813459 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4abd8054-01c2-417f-9b96-99c0bc9dbf83 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:14.813886 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4abd8054-01c2-417f-9b96-99c0bc9dbf83 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:14.946487 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4abd8054-01c2-417f-9b96-99c0bc9dbf83 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:14.954444 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4abd8054-01c2-417f-9b96-99c0bc9dbf83 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.153474 Jun 28 12:08:14.955027 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 232/437] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:14 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:15.972944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb1047a8-bb07-496c-b070-7a3f8c94e335 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:15.973642 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cb1047a8-bb07-496c-b070-7a3f8c94e335 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:15.980312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb1047a8-bb07-496c-b070-7a3f8c94e335 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:15.980757 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb1047a8-bb07-496c-b070-7a3f8c94e335 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:15.981629 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb1047a8-bb07-496c-b070-7a3f8c94e335 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:15.981975 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb1047a8-bb07-496c-b070-7a3f8c94e335 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:16.118521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cb1047a8-bb07-496c-b070-7a3f8c94e335 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:16.128341 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cb1047a8-bb07-496c-b070-7a3f8c94e335 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.159749 Jun 28 12:08:16.129297 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 206/438] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:15 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:16.672968 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8c5d0230-ff16-4d89-a0b6-cee82364836d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "538dae1e-70df-4cc0-8740-79a3736c4ccf"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:16.674545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8c5d0230-ff16-4d89-a0b6-cee82364836d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:16.681191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c5d0230-ff16-4d89-a0b6-cee82364836d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:16.681640 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c5d0230-ff16-4d89-a0b6-cee82364836d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:16.682428 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c5d0230-ff16-4d89-a0b6-cee82364836d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:16.682865 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c5d0230-ff16-4d89-a0b6-cee82364836d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:17.149209 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6b727c4a-7caa-4f35-a969-a3cf20f1c7b2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:17.150169 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6b727c4a-7caa-4f35-a969-a3cf20f1c7b2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:17.160656 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b727c4a-7caa-4f35-a969-a3cf20f1c7b2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:17.161154 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b727c4a-7caa-4f35-a969-a3cf20f1c7b2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:17.161902 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b727c4a-7caa-4f35-a969-a3cf20f1c7b2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:17.162343 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b727c4a-7caa-4f35-a969-a3cf20f1c7b2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:17.304338 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6b727c4a-7caa-4f35-a969-a3cf20f1c7b2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:17.312120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6b727c4a-7caa-4f35-a969-a3cf20f1c7b2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1315 microversion: 2.1 time: 0.169686 Jun 28 12:08:17.312683 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 207/439] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:17 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:08:17.720336 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8c5d0230-ff16-4d89-a0b6-cee82364836d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "POST /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.053829 Jun 28 12:08:17.724960 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 233/440] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:08:16 2022] POST /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments => generated 194 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:08:18.332324 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f558a567-2d64-4868-9922-948e129dfa35 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:18.332965 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f558a567-2d64-4868-9922-948e129dfa35 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:18.340649 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f558a567-2d64-4868-9922-948e129dfa35 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:18.341172 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f558a567-2d64-4868-9922-948e129dfa35 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:18.342007 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f558a567-2d64-4868-9922-948e129dfa35 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:18.342445 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f558a567-2d64-4868-9922-948e129dfa35 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:18.487686 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f558a567-2d64-4868-9922-948e129dfa35 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:18.495432 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f558a567-2d64-4868-9922-948e129dfa35 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1464 microversion: 2.1 time: 0.169130 Jun 28 12:08:18.495999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 208/441] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:18 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:18.537912 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6cbbdfb0-b567-4610-82c4-056e84e517a7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:18.538511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6cbbdfb0-b567-4610-82c4-056e84e517a7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:18.545181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6cbbdfb0-b567-4610-82c4-056e84e517a7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:18.545630 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6cbbdfb0-b567-4610-82c4-056e84e517a7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:18.546385 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6cbbdfb0-b567-4610-82c4-056e84e517a7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:18.546826 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6cbbdfb0-b567-4610-82c4-056e84e517a7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:18.572629 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6cbbdfb0-b567-4610-82c4-056e84e517a7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:08:18.607002 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:18.655383 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6cbbdfb0-b567-4610-82c4-056e84e517a7 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 204 len: 0 microversion: 2.1 time: 0.121954 Jun 28 12:08:18.655873 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 234/442] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:08:18 2022] DELETE /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:08:18.665045 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e3c064ca-f6c7-44ac-b49d-88e29813b31e tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:18.665677 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e3c064ca-f6c7-44ac-b49d-88e29813b31e tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:18.672024 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3c064ca-f6c7-44ac-b49d-88e29813b31e tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:18.672474 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3c064ca-f6c7-44ac-b49d-88e29813b31e tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:18.673283 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3c064ca-f6c7-44ac-b49d-88e29813b31e tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:18.673711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3c064ca-f6c7-44ac-b49d-88e29813b31e tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:18.814486 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3c064ca-f6c7-44ac-b49d-88e29813b31e tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:18.822669 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e3c064ca-f6c7-44ac-b49d-88e29813b31e tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1470 microversion: 2.1 time: 0.161548 Jun 28 12:08:18.823319 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 209/443] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:18 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:19.845886 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d927fc52-b8e0-4aee-aa66-bcb8b7432029 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:19.848163 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d927fc52-b8e0-4aee-aa66-bcb8b7432029 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:19.859380 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d927fc52-b8e0-4aee-aa66-bcb8b7432029 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:19.860123 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d927fc52-b8e0-4aee-aa66-bcb8b7432029 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:19.861533 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d927fc52-b8e0-4aee-aa66-bcb8b7432029 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:19.862636 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d927fc52-b8e0-4aee-aa66-bcb8b7432029 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:20.008681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d927fc52-b8e0-4aee-aa66-bcb8b7432029 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:20.016796 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d927fc52-b8e0-4aee-aa66-bcb8b7432029 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1470 microversion: 2.1 time: 0.178296 Jun 28 12:08:20.017409 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 235/444] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:19 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:21.034413 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f371a75e-a28a-45b1-b224-4264b1123913 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:21.035037 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f371a75e-a28a-45b1-b224-4264b1123913 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:21.041538 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f371a75e-a28a-45b1-b224-4264b1123913 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:21.041984 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f371a75e-a28a-45b1-b224-4264b1123913 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:21.042747 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f371a75e-a28a-45b1-b224-4264b1123913 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:21.043162 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f371a75e-a28a-45b1-b224-4264b1123913 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:21.172006 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f371a75e-a28a-45b1-b224-4264b1123913 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8358ccdda51447d8372602b27f43095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171326d56d234a3d90bc61643b76f113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:21.179653 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f371a75e-a28a-45b1-b224-4264b1123913 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 200 len: 1470 microversion: 2.1 time: 0.149340 Jun 28 12:08:21.180241 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 210/445] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:21 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:21.352836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-a25787f9-2023-4736-b43d-f6c9ebcca81a req-68c5f51e-50fe-47dc-9cc3-306234fd8c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d8c6a7-184f-4b76-b28b-47e5e69357f4", "name": "network-vif-deleted", "tag": "53c721c9-2e6b-4d36-a8f1-f413d7ce762a"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:21.361529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a25787f9-2023-4736-b43d-f6c9ebcca81a req-68c5f51e-50fe-47dc-9cc3-306234fd8c1a service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:21.362715 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a25787f9-2023-4736-b43d-f6c9ebcca81a req-68c5f51e-50fe-47dc-9cc3-306234fd8c1a service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:21.375828 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-a25787f9-2023-4736-b43d-f6c9ebcca81a req-68c5f51e-50fe-47dc-9cc3-306234fd8c1a service nova] Creating event network-vif-deleted:53c721c9-2e6b-4d36-a8f1-f413d7ce762a for instance a6d8c6a7-184f-4b76-b28b-47e5e69357f4 on hv-cinder-84795 Jun 28 12:08:21.381198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-a25787f9-2023-4736-b43d-f6c9ebcca81a req-68c5f51e-50fe-47dc-9cc3-306234fd8c1a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031906 Jun 28 12:08:21.381807 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 236/446] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:08:22.202075 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-217cb576-ed98-407f-8cb1-9de649b47db2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:22.202983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-217cb576-ed98-407f-8cb1-9de649b47db2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] [instance: a6d8c6a7-184f-4b76-b28b-47e5e69357f4] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:22.212356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-217cb576-ed98-407f-8cb1-9de649b47db2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:22.212969 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-217cb576-ed98-407f-8cb1-9de649b47db2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:22.214421 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-217cb576-ed98-407f-8cb1-9de649b47db2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:22.215000 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-217cb576-ed98-407f-8cb1-9de649b47db2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:22.237959 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-217cb576-ed98-407f-8cb1-9de649b47db2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] HTTP exception thrown: Instance a6d8c6a7-184f-4b76-b28b-47e5e69357f4 could not be found. Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-217cb576-ed98-407f-8cb1-9de649b47db2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Request method failure captured: Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 HTTP/1.1 Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu8Ol16PfK3RuqnXwRMOgkWPa8AJV4M0czHuiVa_ogRK7MiDl3UajUXlz0pzooc0gEHuSjVmLaW7F8-7wD5FBwMOhPx9ZOa2WpTBeY05q3DUPfwSf7-VNZvvJCHUGSyl__acBn5x12HkB5_sqUHVRh_pDlGFxGzAH-fE9y6FpR2HmNU Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 171326d56d234a3d90bc61643b76f113 Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-1762621941 Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:08:22.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/171326d56d234a3d90bc61643b76f113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/171326d56d234a3d90bc61643b76f113"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_171326d56d234a3d90bc61643b76f113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/171326d56d234a3d90bc61643b76f113"}]}] Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-1762621941 Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 171326d56d234a3d90bc61643b76f113 Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-1762621941 Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-1762621941-project Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: b8358ccdda51447d8372602b27f43095 Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-1762621941-project Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance a6d8c6a7-184f-4b76-b28b-47e5e69357f4 could not be found. Jun 28 12:08:22.241093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'a6d8c6a7-184f-4b76-b28b-47e5e69357f4'} Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d8c6a7-184f-4b76-b28b-47e5e69357f4 could not be found. Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:08:22.241924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d8c6a7-184f-4b76-b28b-47e5e69357f4 could not be found. Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d8c6a7-184f-4b76-b28b-47e5e69357f4 could not be found. Jun 28 12:08:22.243365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:08:22.245175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-217cb576-ed98-407f-8cb1-9de649b47db2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] Returning 404 to user: Instance a6d8c6a7-184f-4b76-b28b-47e5e69357f4 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:08:22.245175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-217cb576-ed98-407f-8cb1-9de649b47db2 tempest-VolumesNegativeTest-1762621941 tempest-VolumesNegativeTest-1762621941-project] 10.222.0.55 "GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4" status: 404 len: 111 microversion: 2.1 time: 0.045606 Jun 28 12:08:22.245175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 211/447] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:22 2022] GET /compute/v2.1/servers/a6d8c6a7-184f-4b76-b28b-47e5e69357f4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:08:25.226723 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eaaac18a-ce73-4e79-a41d-35954fe9fdbf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:25.227285 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eaaac18a-ce73-4e79-a41d-35954fe9fdbf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:25.229826 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:25.235226 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eaaac18a-ce73-4e79-a41d-35954fe9fdbf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:25.235665 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eaaac18a-ce73-4e79-a41d-35954fe9fdbf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:25.236815 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eaaac18a-ce73-4e79-a41d-35954fe9fdbf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:25.237292 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eaaac18a-ce73-4e79-a41d-35954fe9fdbf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:25.264034 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-eaaac18a-ce73-4e79-a41d-35954fe9fdbf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/ips" status: 200 len: 151 microversion: 2.20 time: 0.042226 Jun 28 12:08:25.264609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 237/448] 10.222.0.55 () {60 vars in 1288 bytes} [Tue Jun 28 12:08:25 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 12:08:25.315191 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8fab401b-5c82-44a5-ace1-9710b959a490 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:25.315882 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8fab401b-5c82-44a5-ace1-9710b959a490 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:25.318582 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:25.324700 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8fab401b-5c82-44a5-ace1-9710b959a490 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:25.325179 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8fab401b-5c82-44a5-ace1-9710b959a490 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:25.325943 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8fab401b-5c82-44a5-ace1-9710b959a490 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:25.326380 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8fab401b-5c82-44a5-ace1-9710b959a490 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:25.469991 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8fab401b-5c82-44a5-ace1-9710b959a490 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:25.478566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8fab401b-5c82-44a5-ace1-9710b959a490 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1595 microversion: 2.1 time: 0.167175 Jun 28 12:08:25.479171 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 212/449] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:25 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1595 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:27.526383 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-ebfbb5fe-539e-4478-91a5-95183e9125db req-ffd20063-7aa3-4748-a535-206c70b53902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583b6c67-8700-4030-953d-58678d33b913", "tag": "d4c7a854-153d-4c80-a397-448ffe963bca"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:27.538247 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-ebfbb5fe-539e-4478-91a5-95183e9125db req-ffd20063-7aa3-4748-a535-206c70b53902 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:27.538887 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-ebfbb5fe-539e-4478-91a5-95183e9125db req-ffd20063-7aa3-4748-a535-206c70b53902 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:27.552832 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-ebfbb5fe-539e-4478-91a5-95183e9125db req-ffd20063-7aa3-4748-a535-206c70b53902 service nova] Creating event network-changed:d4c7a854-153d-4c80-a397-448ffe963bca for instance 583b6c67-8700-4030-953d-58678d33b913 on hv-cinder-84795 Jun 28 12:08:27.553594 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-edc0b8ab-9b82-4545-b611-4bb73423cf92 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:27.554134 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-edc0b8ab-9b82-4545-b611-4bb73423cf92 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:27.561009 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-ebfbb5fe-539e-4478-91a5-95183e9125db req-ffd20063-7aa3-4748-a535-206c70b53902 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039432 Jun 28 12:08:27.561851 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 238/450] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:08:27.569173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edc0b8ab-9b82-4545-b611-4bb73423cf92 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:27.569633 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edc0b8ab-9b82-4545-b611-4bb73423cf92 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:27.570707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edc0b8ab-9b82-4545-b611-4bb73423cf92 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:27.571231 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edc0b8ab-9b82-4545-b611-4bb73423cf92 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:27.604328 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-edc0b8ab-9b82-4545-b611-4bb73423cf92 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lazy-loading 'flavor' on Instance uuid 350964d7-7d2a-4335-b45e-c50e8cd87f7d {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:08:27.709516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:28.149194 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-edc0b8ab-9b82-4545-b611-4bb73423cf92 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "POST /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/action" status: 202 len: 0 microversion: 2.20 time: 0.600315 Jun 28 12:08:28.150405 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 213/451] 10.222.0.55 () {62 vars in 1318 bytes} [Tue Jun 28 12:08:27 2022] POST /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:08:28.162090 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-921bda32-a694-40d9-a574-2275ee686df4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:28.163149 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-921bda32-a694-40d9-a574-2275ee686df4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:28.175584 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-921bda32-a694-40d9-a574-2275ee686df4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:28.177917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-921bda32-a694-40d9-a574-2275ee686df4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:28.180194 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-921bda32-a694-40d9-a574-2275ee686df4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:28.180653 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-921bda32-a694-40d9-a574-2275ee686df4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:28.511127 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-921bda32-a694-40d9-a574-2275ee686df4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:28.520888 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-921bda32-a694-40d9-a574-2275ee686df4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:28.522492 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-921bda32-a694-40d9-a574-2275ee686df4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:28.523774 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-921bda32-a694-40d9-a574-2275ee686df4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.368657 Jun 28 12:08:28.534708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 239/452] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:28 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:29.382057 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4efbb5d5-cb57-49fb-8628-ed878dcde8d4 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1077003342"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:29.382743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4efbb5d5-cb57-49fb-8628-ed878dcde8d4 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:29.384651 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=48 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:29.392098 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4efbb5d5-cb57-49fb-8628-ed878dcde8d4 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:29.392435 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4efbb5d5-cb57-49fb-8628-ed878dcde8d4 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:29.393246 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4efbb5d5-cb57-49fb-8628-ed878dcde8d4 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:29.393693 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4efbb5d5-cb57-49fb-8628-ed878dcde8d4 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:29.529463 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.network.security_group_api [None req-4efbb5d5-cb57-49fb-8628-ed878dcde8d4 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Adding security group fa9f9bd7-5594-4efc-b238-6c6bf20cf94b to port d4c7a854-153d-4c80-a397-448ffe963bca Jun 28 12:08:29.545874 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-338753e3-0f9e-4703-a276-39cd5caab131 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:29.546557 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-338753e3-0f9e-4703-a276-39cd5caab131 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:29.553750 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-338753e3-0f9e-4703-a276-39cd5caab131 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:29.554478 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-338753e3-0f9e-4703-a276-39cd5caab131 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:29.555266 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-338753e3-0f9e-4703-a276-39cd5caab131 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:29.555699 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-338753e3-0f9e-4703-a276-39cd5caab131 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:29.806200 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-338753e3-0f9e-4703-a276-39cd5caab131 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:29.815005 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-338753e3-0f9e-4703-a276-39cd5caab131 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:29.816560 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-338753e3-0f9e-4703-a276-39cd5caab131 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:29.818049 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-338753e3-0f9e-4703-a276-39cd5caab131 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.276435 Jun 28 12:08:29.818483 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 240/453] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:29 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:29.947770 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4efbb5d5-cb57-49fb-8628-ed878dcde8d4 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "POST /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/action" status: 202 len: 0 microversion: 2.1 time: 0.570756 Jun 28 12:08:29.948528 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 214/454] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:08:29 2022] POST /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:08:29.957092 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-064d1570-3284-4698-bd79-2cca6d495c31 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:29.957686 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-064d1570-3284-4698-bd79-2cca6d495c31 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:29.962740 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-2367bc65-5b75-4b7d-a7fe-c89920bb2196 req-704057e0-e948-40bf-b0e8-b92bba8ce2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583b6c67-8700-4030-953d-58678d33b913", "tag": "d4c7a854-153d-4c80-a397-448ffe963bca"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:29.974812 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-064d1570-3284-4698-bd79-2cca6d495c31 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:29.976327 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-2367bc65-5b75-4b7d-a7fe-c89920bb2196 req-704057e0-e948-40bf-b0e8-b92bba8ce2f6 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:29.976473 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-064d1570-3284-4698-bd79-2cca6d495c31 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:29.976985 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-2367bc65-5b75-4b7d-a7fe-c89920bb2196 req-704057e0-e948-40bf-b0e8-b92bba8ce2f6 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:29.977202 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-064d1570-3284-4698-bd79-2cca6d495c31 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:29.977628 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-064d1570-3284-4698-bd79-2cca6d495c31 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:29.991513 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-2367bc65-5b75-4b7d-a7fe-c89920bb2196 req-704057e0-e948-40bf-b0e8-b92bba8ce2f6 service nova] Creating event network-changed:d4c7a854-153d-4c80-a397-448ffe963bca for instance 583b6c67-8700-4030-953d-58678d33b913 on hv-cinder-84795 Jun 28 12:08:29.997032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-2367bc65-5b75-4b7d-a7fe-c89920bb2196 req-704057e0-e948-40bf-b0e8-b92bba8ce2f6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037757 Jun 28 12:08:29.997774 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 215/455] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:08:30.134792 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-064d1570-3284-4698-bd79-2cca6d495c31 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:30.142902 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-064d1570-3284-4698-bd79-2cca6d495c31 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1761 microversion: 2.1 time: 0.190073 Jun 28 12:08:30.143465 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 241/456] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:29 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1761 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:30.837907 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8432a88f-d158-450b-8cb8-dec1e4126104 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:30.839057 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8432a88f-d158-450b-8cb8-dec1e4126104 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:30.845880 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8432a88f-d158-450b-8cb8-dec1e4126104 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:30.846334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8432a88f-d158-450b-8cb8-dec1e4126104 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:30.847101 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8432a88f-d158-450b-8cb8-dec1e4126104 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:30.847529 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8432a88f-d158-450b-8cb8-dec1e4126104 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:30.899747 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f0f08941-a6f1-4e69-8218-aa9cecdb9c98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:30.900349 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f0f08941-a6f1-4e69-8218-aa9cecdb9c98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:30.907451 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f0f08941-a6f1-4e69-8218-aa9cecdb9c98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:30.908001 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f0f08941-a6f1-4e69-8218-aa9cecdb9c98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:30.908846 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f0f08941-a6f1-4e69-8218-aa9cecdb9c98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:30.909403 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f0f08941-a6f1-4e69-8218-aa9cecdb9c98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:30.933489 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f0f08941-a6f1-4e69-8218-aa9cecdb9c98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/ips" status: 200 len: 146 microversion: 2.1 time: 0.037932 Jun 28 12:08:30.936967 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 242/457] 10.222.0.55 () {58 vars in 1247 bytes} [Tue Jun 28 12:08:30 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:08:30.985564 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8432a88f-d158-450b-8cb8-dec1e4126104 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:30.994187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8432a88f-d158-450b-8cb8-dec1e4126104 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:30.995684 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8432a88f-d158-450b-8cb8-dec1e4126104 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:30.996844 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8432a88f-d158-450b-8cb8-dec1e4126104 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.163897 Jun 28 12:08:30.997431 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 216/458] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:30 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:32.024142 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-33673c21-51da-4cde-8b52-9ba85d63360b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:32.025560 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-33673c21-51da-4cde-8b52-9ba85d63360b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:32.034178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33673c21-51da-4cde-8b52-9ba85d63360b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:32.034762 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33673c21-51da-4cde-8b52-9ba85d63360b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:32.035660 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33673c21-51da-4cde-8b52-9ba85d63360b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:32.036271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33673c21-51da-4cde-8b52-9ba85d63360b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:32.188932 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-33673c21-51da-4cde-8b52-9ba85d63360b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:32.199291 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-33673c21-51da-4cde-8b52-9ba85d63360b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:32.201702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-33673c21-51da-4cde-8b52-9ba85d63360b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:32.203457 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-33673c21-51da-4cde-8b52-9ba85d63360b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.185004 Jun 28 12:08:32.204401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 243/459] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:32 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:33.232753 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e2ca08da-cbb1-4985-ba13-f76f3a1a45ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:33.233694 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e2ca08da-cbb1-4985-ba13-f76f3a1a45ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:33.242135 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2ca08da-cbb1-4985-ba13-f76f3a1a45ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:33.242709 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2ca08da-cbb1-4985-ba13-f76f3a1a45ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:33.243481 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2ca08da-cbb1-4985-ba13-f76f3a1a45ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:33.243922 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2ca08da-cbb1-4985-ba13-f76f3a1a45ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:33.383639 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e2ca08da-cbb1-4985-ba13-f76f3a1a45ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:33.391953 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e2ca08da-cbb1-4985-ba13-f76f3a1a45ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:33.393631 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e2ca08da-cbb1-4985-ba13-f76f3a1a45ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:33.394702 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e2ca08da-cbb1-4985-ba13-f76f3a1a45ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.168836 Jun 28 12:08:33.395809 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 217/460] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:33 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:34.415865 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a3e6ee02-1c7a-4220-ac5c-155e4d8533ae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:34.416475 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a3e6ee02-1c7a-4220-ac5c-155e4d8533ae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:34.423362 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3e6ee02-1c7a-4220-ac5c-155e4d8533ae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:34.423817 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3e6ee02-1c7a-4220-ac5c-155e4d8533ae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:34.424633 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3e6ee02-1c7a-4220-ac5c-155e4d8533ae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:34.425106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3e6ee02-1c7a-4220-ac5c-155e4d8533ae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:34.564508 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a3e6ee02-1c7a-4220-ac5c-155e4d8533ae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:34.573920 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a3e6ee02-1c7a-4220-ac5c-155e4d8533ae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:34.575450 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a3e6ee02-1c7a-4220-ac5c-155e4d8533ae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:34.576618 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a3e6ee02-1c7a-4220-ac5c-155e4d8533ae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.165912 Jun 28 12:08:34.577191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 244/461] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:34 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:35.115623 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7b1e19a0-d8c2-4e76-a1ee-7ce0e0595a5b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f24835a0-2f78-4d44-8ed5-9f9dd87aec97"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:35.116842 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7b1e19a0-d8c2-4e76-a1ee-7ce0e0595a5b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:35.123240 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b1e19a0-d8c2-4e76-a1ee-7ce0e0595a5b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:35.123688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b1e19a0-d8c2-4e76-a1ee-7ce0e0595a5b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:35.124452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b1e19a0-d8c2-4e76-a1ee-7ce0e0595a5b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:35.124885 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b1e19a0-d8c2-4e76-a1ee-7ce0e0595a5b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:35.418442 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7b1e19a0-d8c2-4e76-a1ee-7ce0e0595a5b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "POST /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306897 Jun 28 12:08:35.419052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 218/462] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:08:35 2022] POST /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:08:35.595452 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9cbc6249-b6a8-4a17-bc4f-f78eedfcba17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:35.595877 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9cbc6249-b6a8-4a17-bc4f-f78eedfcba17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:35.603031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9cbc6249-b6a8-4a17-bc4f-f78eedfcba17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:35.603435 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9cbc6249-b6a8-4a17-bc4f-f78eedfcba17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:35.604568 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9cbc6249-b6a8-4a17-bc4f-f78eedfcba17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:35.605357 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9cbc6249-b6a8-4a17-bc4f-f78eedfcba17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:35.740788 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9cbc6249-b6a8-4a17-bc4f-f78eedfcba17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:35.749288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9cbc6249-b6a8-4a17-bc4f-f78eedfcba17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:35.750894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9cbc6249-b6a8-4a17-bc4f-f78eedfcba17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:35.752060 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9cbc6249-b6a8-4a17-bc4f-f78eedfcba17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.160655 Jun 28 12:08:35.752598 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 245/463] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:35 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:36.772443 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-315ee678-c3b9-402c-9fb6-580815604fd0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:36.773258 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-315ee678-c3b9-402c-9fb6-580815604fd0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:36.781061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-315ee678-c3b9-402c-9fb6-580815604fd0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:36.781640 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-315ee678-c3b9-402c-9fb6-580815604fd0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:36.784197 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-315ee678-c3b9-402c-9fb6-580815604fd0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:36.784726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-315ee678-c3b9-402c-9fb6-580815604fd0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:36.929414 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-315ee678-c3b9-402c-9fb6-580815604fd0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:36.938059 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-315ee678-c3b9-402c-9fb6-580815604fd0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:36.939541 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-315ee678-c3b9-402c-9fb6-580815604fd0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:36.940724 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-315ee678-c3b9-402c-9fb6-580815604fd0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.172531 Jun 28 12:08:36.941284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 219/464] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:36 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:37.963201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fc197d9a-a64c-4f46-8056-8b4fdd37faf7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:37.964542 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fc197d9a-a64c-4f46-8056-8b4fdd37faf7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:37.975893 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc197d9a-a64c-4f46-8056-8b4fdd37faf7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:37.976676 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc197d9a-a64c-4f46-8056-8b4fdd37faf7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:37.978144 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc197d9a-a64c-4f46-8056-8b4fdd37faf7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:37.978585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fc197d9a-a64c-4f46-8056-8b4fdd37faf7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:38.122158 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fc197d9a-a64c-4f46-8056-8b4fdd37faf7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:38.130697 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fc197d9a-a64c-4f46-8056-8b4fdd37faf7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:38.132190 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fc197d9a-a64c-4f46-8056-8b4fdd37faf7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:38.133373 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fc197d9a-a64c-4f46-8056-8b4fdd37faf7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.177366 Jun 28 12:08:38.133921 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 246/465] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:37 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:39.155643 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e694e002-1064-4269-95fd-9626cdcefcd5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:39.156291 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e694e002-1064-4269-95fd-9626cdcefcd5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:39.164162 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e694e002-1064-4269-95fd-9626cdcefcd5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:39.164666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e694e002-1064-4269-95fd-9626cdcefcd5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:39.165669 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e694e002-1064-4269-95fd-9626cdcefcd5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:39.166160 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e694e002-1064-4269-95fd-9626cdcefcd5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:39.312042 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e694e002-1064-4269-95fd-9626cdcefcd5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:39.320233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e694e002-1064-4269-95fd-9626cdcefcd5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:39.321966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e694e002-1064-4269-95fd-9626cdcefcd5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:39.323236 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e694e002-1064-4269-95fd-9626cdcefcd5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.172090 Jun 28 12:08:39.323799 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 220/466] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:39 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:40.346985 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5f5600ab-7086-47c2-8cab-1bdc6ccf7325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:40.348030 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5f5600ab-7086-47c2-8cab-1bdc6ccf7325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:40.357579 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f5600ab-7086-47c2-8cab-1bdc6ccf7325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:40.358033 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f5600ab-7086-47c2-8cab-1bdc6ccf7325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:40.358804 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f5600ab-7086-47c2-8cab-1bdc6ccf7325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:40.359241 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f5600ab-7086-47c2-8cab-1bdc6ccf7325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:40.506826 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5f5600ab-7086-47c2-8cab-1bdc6ccf7325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:40.519890 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5f5600ab-7086-47c2-8cab-1bdc6ccf7325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:40.522392 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5f5600ab-7086-47c2-8cab-1bdc6ccf7325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:40.524219 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5f5600ab-7086-47c2-8cab-1bdc6ccf7325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.183719 Jun 28 12:08:40.525093 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 247/467] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:40 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:41.547825 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-31732e74-791e-4c78-8571-e7e52f1f13ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:41.548743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-31732e74-791e-4c78-8571-e7e52f1f13ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:41.557536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-31732e74-791e-4c78-8571-e7e52f1f13ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:41.557990 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-31732e74-791e-4c78-8571-e7e52f1f13ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:41.558755 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-31732e74-791e-4c78-8571-e7e52f1f13ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:41.559187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-31732e74-791e-4c78-8571-e7e52f1f13ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:41.700154 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-31732e74-791e-4c78-8571-e7e52f1f13ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:41.708234 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-31732e74-791e-4c78-8571-e7e52f1f13ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:41.709775 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-31732e74-791e-4c78-8571-e7e52f1f13ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:41.710937 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-31732e74-791e-4c78-8571-e7e52f1f13ee tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.169302 Jun 28 12:08:41.711496 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 221/468] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:41 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:42.730040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b15ae0bf-d2b0-493b-9389-6af7f761ad23 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:42.730613 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b15ae0bf-d2b0-493b-9389-6af7f761ad23 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:42.737418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b15ae0bf-d2b0-493b-9389-6af7f761ad23 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:42.737868 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b15ae0bf-d2b0-493b-9389-6af7f761ad23 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:42.738622 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b15ae0bf-d2b0-493b-9389-6af7f761ad23 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:42.739051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b15ae0bf-d2b0-493b-9389-6af7f761ad23 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:42.876936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b15ae0bf-d2b0-493b-9389-6af7f761ad23 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:42.886156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b15ae0bf-d2b0-493b-9389-6af7f761ad23 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:42.888180 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b15ae0bf-d2b0-493b-9389-6af7f761ad23 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:42.889568 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b15ae0bf-d2b0-493b-9389-6af7f761ad23 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.163546 Jun 28 12:08:42.890130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 248/469] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:42 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:42.963946 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-11460e75-dbae-424b-81f4-788294eb4b6d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:42.970983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11460e75-dbae-424b-81f4-788294eb4b6d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:42.971438 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11460e75-dbae-424b-81f4-788294eb4b6d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:43.033319 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-11460e75-dbae-424b-81f4-788294eb4b6d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Going to try to stop instance {{(pid=117889) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 28 12:08:43.081225 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-11460e75-dbae-424b-81f4-788294eb4b6d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "POST /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/action" status: 202 len: 0 microversion: 2.1 time: 0.121265 Jun 28 12:08:43.082035 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 222/470] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:08:42 2022] POST /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:08:43.091420 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d2a9f43b-9588-4908-88ac-09f1de85cc4e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:43.092026 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d2a9f43b-9588-4908-88ac-09f1de85cc4e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:43.098187 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2a9f43b-9588-4908-88ac-09f1de85cc4e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:43.098673 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2a9f43b-9588-4908-88ac-09f1de85cc4e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:43.099474 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2a9f43b-9588-4908-88ac-09f1de85cc4e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:43.099968 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2a9f43b-9588-4908-88ac-09f1de85cc4e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:43.246315 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d2a9f43b-9588-4908-88ac-09f1de85cc4e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:43.267426 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d2a9f43b-9588-4908-88ac-09f1de85cc4e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1723 microversion: 2.1 time: 0.181020 Jun 28 12:08:43.267993 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 249/471] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:43 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:43.912746 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-80030574-c897-40dd-b5a9-1a1229f21080 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:43.913502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-80030574-c897-40dd-b5a9-1a1229f21080 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:43.922114 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80030574-c897-40dd-b5a9-1a1229f21080 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:43.922568 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80030574-c897-40dd-b5a9-1a1229f21080 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:43.923335 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80030574-c897-40dd-b5a9-1a1229f21080 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:43.923770 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80030574-c897-40dd-b5a9-1a1229f21080 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:44.065455 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80030574-c897-40dd-b5a9-1a1229f21080 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:44.074545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80030574-c897-40dd-b5a9-1a1229f21080 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:44.076509 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80030574-c897-40dd-b5a9-1a1229f21080 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:44.077758 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-80030574-c897-40dd-b5a9-1a1229f21080 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.172161 Jun 28 12:08:44.078481 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 223/472] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:43 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:44.289203 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4a10cfad-8ad0-4d12-9f3c-3490a9996b98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:44.290140 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4a10cfad-8ad0-4d12-9f3c-3490a9996b98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:44.301286 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a10cfad-8ad0-4d12-9f3c-3490a9996b98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:44.301959 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a10cfad-8ad0-4d12-9f3c-3490a9996b98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:44.303082 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a10cfad-8ad0-4d12-9f3c-3490a9996b98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:44.303699 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4a10cfad-8ad0-4d12-9f3c-3490a9996b98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:44.443301 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4a10cfad-8ad0-4d12-9f3c-3490a9996b98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:44.455878 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4a10cfad-8ad0-4d12-9f3c-3490a9996b98 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1723 microversion: 2.1 time: 0.173019 Jun 28 12:08:44.456538 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 250/473] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:44 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:45.101441 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-56623972-99c8-42c5-81c2-ed715c9515a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:45.102365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-56623972-99c8-42c5-81c2-ed715c9515a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:45.113493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56623972-99c8-42c5-81c2-ed715c9515a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:45.113783 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56623972-99c8-42c5-81c2-ed715c9515a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:45.115029 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56623972-99c8-42c5-81c2-ed715c9515a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:45.115779 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56623972-99c8-42c5-81c2-ed715c9515a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:45.253525 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-56623972-99c8-42c5-81c2-ed715c9515a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:45.261846 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-56623972-99c8-42c5-81c2-ed715c9515a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:45.263492 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-56623972-99c8-42c5-81c2-ed715c9515a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:45.264700 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-56623972-99c8-42c5-81c2-ed715c9515a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1744 microversion: 2.20 time: 0.169950 Jun 28 12:08:45.265508 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 224/474] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:45 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:45.477952 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ae38c08d-32c8-4610-85a8-292ded3c46f5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:45.478950 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ae38c08d-32c8-4610-85a8-292ded3c46f5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:45.487123 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae38c08d-32c8-4610-85a8-292ded3c46f5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:45.487568 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae38c08d-32c8-4610-85a8-292ded3c46f5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:45.488328 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae38c08d-32c8-4610-85a8-292ded3c46f5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:45.488756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae38c08d-32c8-4610-85a8-292ded3c46f5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:45.626995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ae38c08d-32c8-4610-85a8-292ded3c46f5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:45.635479 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ae38c08d-32c8-4610-85a8-292ded3c46f5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1723 microversion: 2.1 time: 0.164062 Jun 28 12:08:45.636044 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 251/475] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:45 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:46.290957 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-90005651-125d-41cb-ab3d-d345a2bad1f8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:46.291807 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-90005651-125d-41cb-ab3d-d345a2bad1f8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:46.300175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90005651-125d-41cb-ab3d-d345a2bad1f8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:46.300622 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90005651-125d-41cb-ab3d-d345a2bad1f8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:46.301416 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90005651-125d-41cb-ab3d-d345a2bad1f8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:46.301842 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-90005651-125d-41cb-ab3d-d345a2bad1f8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:46.441419 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-90005651-125d-41cb-ab3d-d345a2bad1f8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:46.449929 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-90005651-125d-41cb-ab3d-d345a2bad1f8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:46.451430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-90005651-125d-41cb-ab3d-d345a2bad1f8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:46.452594 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-90005651-125d-41cb-ab3d-d345a2bad1f8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1744 microversion: 2.20 time: 0.168224 Jun 28 12:08:46.453204 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 225/476] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:46 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:46.657108 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cf4834e7-0a72-45c2-868e-6fd85a3fa726 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:46.657807 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cf4834e7-0a72-45c2-868e-6fd85a3fa726 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:46.666995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf4834e7-0a72-45c2-868e-6fd85a3fa726 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:46.667586 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf4834e7-0a72-45c2-868e-6fd85a3fa726 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:46.668610 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf4834e7-0a72-45c2-868e-6fd85a3fa726 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:46.669254 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf4834e7-0a72-45c2-868e-6fd85a3fa726 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:46.810582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cf4834e7-0a72-45c2-868e-6fd85a3fa726 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:46.814305 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:46.819579 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cf4834e7-0a72-45c2-868e-6fd85a3fa726 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1723 microversion: 2.1 time: 0.168786 Jun 28 12:08:46.820146 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 252/477] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:46 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:47.474880 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-99c4e4b1-db3f-4399-a96f-0e074a841b19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:47.475483 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-99c4e4b1-db3f-4399-a96f-0e074a841b19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:47.482463 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-99c4e4b1-db3f-4399-a96f-0e074a841b19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:47.482881 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-99c4e4b1-db3f-4399-a96f-0e074a841b19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:47.483809 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-99c4e4b1-db3f-4399-a96f-0e074a841b19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:47.484217 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-99c4e4b1-db3f-4399-a96f-0e074a841b19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:47.627017 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-99c4e4b1-db3f-4399-a96f-0e074a841b19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:47.635571 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-99c4e4b1-db3f-4399-a96f-0e074a841b19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:47.637118 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-99c4e4b1-db3f-4399-a96f-0e074a841b19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:47.638290 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-99c4e4b1-db3f-4399-a96f-0e074a841b19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1744 microversion: 2.20 time: 0.169408 Jun 28 12:08:47.638854 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 226/478] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:47 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:47.841251 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7257ab82-9513-4a6f-beb5-ead443cce009 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:47.841888 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7257ab82-9513-4a6f-beb5-ead443cce009 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:47.848846 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7257ab82-9513-4a6f-beb5-ead443cce009 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:47.849333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7257ab82-9513-4a6f-beb5-ead443cce009 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:47.850094 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7257ab82-9513-4a6f-beb5-ead443cce009 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:47.850593 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7257ab82-9513-4a6f-beb5-ead443cce009 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:47.982101 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7257ab82-9513-4a6f-beb5-ead443cce009 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:47.990427 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7257ab82-9513-4a6f-beb5-ead443cce009 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1723 microversion: 2.1 time: 0.154243 Jun 28 12:08:47.991029 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 253/479] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:47 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:48.660938 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bf9d75f1-5820-49ac-9de9-e08945392ad0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:48.661563 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bf9d75f1-5820-49ac-9de9-e08945392ad0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:48.673223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf9d75f1-5820-49ac-9de9-e08945392ad0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:48.674014 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf9d75f1-5820-49ac-9de9-e08945392ad0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:48.674833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf9d75f1-5820-49ac-9de9-e08945392ad0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:48.675271 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf9d75f1-5820-49ac-9de9-e08945392ad0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:48.691170 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=92,nova_cell1:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:48.831474 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf9d75f1-5820-49ac-9de9-e08945392ad0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:48.839877 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf9d75f1-5820-49ac-9de9-e08945392ad0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:48.841847 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf9d75f1-5820-49ac-9de9-e08945392ad0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:48.843554 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bf9d75f1-5820-49ac-9de9-e08945392ad0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1744 microversion: 2.20 time: 0.188026 Jun 28 12:08:48.844239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 227/480] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:48 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:49.008358 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d3b43b31-8030-4a36-8c69-2499655defd3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:49.009135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d3b43b31-8030-4a36-8c69-2499655defd3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:49.016088 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3b43b31-8030-4a36-8c69-2499655defd3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:49.016635 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3b43b31-8030-4a36-8c69-2499655defd3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:49.017428 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3b43b31-8030-4a36-8c69-2499655defd3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:49.017864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3b43b31-8030-4a36-8c69-2499655defd3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:49.163945 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d3b43b31-8030-4a36-8c69-2499655defd3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:49.172413 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d3b43b31-8030-4a36-8c69-2499655defd3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1723 microversion: 2.1 time: 0.168179 Jun 28 12:08:49.173067 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 254/481] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:49 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:49.862479 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8c043c2f-7802-47d9-836d-4a074a01298a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:49.863661 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8c043c2f-7802-47d9-836d-4a074a01298a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:49.871688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c043c2f-7802-47d9-836d-4a074a01298a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:49.872134 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c043c2f-7802-47d9-836d-4a074a01298a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:49.873106 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c043c2f-7802-47d9-836d-4a074a01298a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:49.873722 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c043c2f-7802-47d9-836d-4a074a01298a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:49.887651 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-f535a02a-0abc-4e82-9799-fa70e9f3952d req-b677f4ac-eff3-440f-98d4-b7a5cdf210f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350964d7-7d2a-4335-b45e-c50e8cd87f7d", "name": "network-vif-plugged", "status": "completed", "tag": "5f8ebf1b-007a-4caf-9a83-c43616b46917"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:49.896838 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-f535a02a-0abc-4e82-9799-fa70e9f3952d req-b677f4ac-eff3-440f-98d4-b7a5cdf210f6 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:49.897324 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-f535a02a-0abc-4e82-9799-fa70e9f3952d req-b677f4ac-eff3-440f-98d4-b7a5cdf210f6 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:49.910621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-f535a02a-0abc-4e82-9799-fa70e9f3952d req-b677f4ac-eff3-440f-98d4-b7a5cdf210f6 service nova] Creating event network-vif-plugged:5f8ebf1b-007a-4caf-9a83-c43616b46917 for instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d on hv-cinder-84795 Jun 28 12:08:49.915987 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-f535a02a-0abc-4e82-9799-fa70e9f3952d req-b677f4ac-eff3-440f-98d4-b7a5cdf210f6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031934 Jun 28 12:08:49.916730 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 255/482] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:08:50.023331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8c043c2f-7802-47d9-836d-4a074a01298a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:50.031371 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8c043c2f-7802-47d9-836d-4a074a01298a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:50.032941 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8c043c2f-7802-47d9-836d-4a074a01298a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:50.034165 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8c043c2f-7802-47d9-836d-4a074a01298a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1744 microversion: 2.20 time: 0.175599 Jun 28 12:08:50.034730 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 228/483] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:49 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:50.196084 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b116678b-3b53-497d-bbe1-58390780063b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:50.197124 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b116678b-3b53-497d-bbe1-58390780063b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:50.207866 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b116678b-3b53-497d-bbe1-58390780063b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:50.208640 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b116678b-3b53-497d-bbe1-58390780063b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:50.210007 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b116678b-3b53-497d-bbe1-58390780063b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:50.210727 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b116678b-3b53-497d-bbe1-58390780063b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:50.350704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b116678b-3b53-497d-bbe1-58390780063b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:50.359031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b116678b-3b53-497d-bbe1-58390780063b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1723 microversion: 2.1 time: 0.170797 Jun 28 12:08:50.359605 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 256/484] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:50 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:51.052542 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bdc1fff1-9638-45d8-89db-9c95fe8248da tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:51.053267 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bdc1fff1-9638-45d8-89db-9c95fe8248da tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:51.060154 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bdc1fff1-9638-45d8-89db-9c95fe8248da tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:51.060686 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bdc1fff1-9638-45d8-89db-9c95fe8248da tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:51.061540 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bdc1fff1-9638-45d8-89db-9c95fe8248da tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:51.062301 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bdc1fff1-9638-45d8-89db-9c95fe8248da tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:51.196442 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bdc1fff1-9638-45d8-89db-9c95fe8248da tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:51.205134 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bdc1fff1-9638-45d8-89db-9c95fe8248da tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:51.206647 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bdc1fff1-9638-45d8-89db-9c95fe8248da tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:51.207795 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bdc1fff1-9638-45d8-89db-9c95fe8248da tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1744 microversion: 2.20 time: 0.159232 Jun 28 12:08:51.208326 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 229/485] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:51 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:51.376117 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-25931db7-eedc-4438-b4ee-d806a9497415 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:51.376642 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-25931db7-eedc-4438-b4ee-d806a9497415 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:51.384089 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25931db7-eedc-4438-b4ee-d806a9497415 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:51.384571 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25931db7-eedc-4438-b4ee-d806a9497415 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:51.385393 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25931db7-eedc-4438-b4ee-d806a9497415 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:51.385831 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25931db7-eedc-4438-b4ee-d806a9497415 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:51.524501 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-25931db7-eedc-4438-b4ee-d806a9497415 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:51.534630 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-25931db7-eedc-4438-b4ee-d806a9497415 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1723 microversion: 2.1 time: 0.162325 Jun 28 12:08:51.535219 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 257/486] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:51 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:52.226837 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-93c1d088-aadf-4acf-89d7-dbc7cbf9da42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:52.227463 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-93c1d088-aadf-4acf-89d7-dbc7cbf9da42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:52.234315 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-93c1d088-aadf-4acf-89d7-dbc7cbf9da42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:52.234989 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-93c1d088-aadf-4acf-89d7-dbc7cbf9da42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:52.236470 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-93c1d088-aadf-4acf-89d7-dbc7cbf9da42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:52.236934 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-93c1d088-aadf-4acf-89d7-dbc7cbf9da42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:52.382503 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-93c1d088-aadf-4acf-89d7-dbc7cbf9da42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:52.390556 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-93c1d088-aadf-4acf-89d7-dbc7cbf9da42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:52.392046 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-93c1d088-aadf-4acf-89d7-dbc7cbf9da42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:52.393220 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-93c1d088-aadf-4acf-89d7-dbc7cbf9da42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1739 microversion: 2.20 time: 0.170299 Jun 28 12:08:52.393776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 230/487] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:52 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:52.551873 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-45d68644-64c9-496a-8ea2-6632f4ff4a5c tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:52.552501 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-45d68644-64c9-496a-8ea2-6632f4ff4a5c tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:52.559387 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45d68644-64c9-496a-8ea2-6632f4ff4a5c tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:52.559831 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45d68644-64c9-496a-8ea2-6632f4ff4a5c tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:52.560591 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45d68644-64c9-496a-8ea2-6632f4ff4a5c tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:52.561051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-45d68644-64c9-496a-8ea2-6632f4ff4a5c tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:52.726716 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-45d68644-64c9-496a-8ea2-6632f4ff4a5c tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:52.736495 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-45d68644-64c9-496a-8ea2-6632f4ff4a5c tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1723 microversion: 2.1 time: 0.188525 Jun 28 12:08:52.737112 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 258/488] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:52 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:53.412539 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4bc052eb-a2f2-4c38-a861-99c5a95cb53b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:53.414064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4bc052eb-a2f2-4c38-a861-99c5a95cb53b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:53.421878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bc052eb-a2f2-4c38-a861-99c5a95cb53b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:53.422558 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bc052eb-a2f2-4c38-a861-99c5a95cb53b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:53.423527 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bc052eb-a2f2-4c38-a861-99c5a95cb53b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:53.424119 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4bc052eb-a2f2-4c38-a861-99c5a95cb53b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:53.621137 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4bc052eb-a2f2-4c38-a861-99c5a95cb53b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:53.636173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4bc052eb-a2f2-4c38-a861-99c5a95cb53b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:53.638055 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4bc052eb-a2f2-4c38-a861-99c5a95cb53b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:53.642775 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4bc052eb-a2f2-4c38-a861-99c5a95cb53b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1739 microversion: 2.20 time: 0.234024 Jun 28 12:08:53.644088 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 231/489] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:53 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:53.754592 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ae186d4b-b66e-45e8-9f26-188dc3655d62 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:53.756077 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ae186d4b-b66e-45e8-9f26-188dc3655d62 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:53.764103 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae186d4b-b66e-45e8-9f26-188dc3655d62 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:53.765126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae186d4b-b66e-45e8-9f26-188dc3655d62 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:53.766231 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae186d4b-b66e-45e8-9f26-188dc3655d62 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:53.766673 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae186d4b-b66e-45e8-9f26-188dc3655d62 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:53.942380 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ae186d4b-b66e-45e8-9f26-188dc3655d62 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:53.954549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ae186d4b-b66e-45e8-9f26-188dc3655d62 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1700 microversion: 2.1 time: 0.204534 Jun 28 12:08:53.955638 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 259/490] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:53 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1700 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:53.976639 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-99049ef4-8c18-4a5f-a33c-dd23af907145 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:08:53.991742 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-99049ef4-8c18-4a5f-a33c-dd23af907145 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:53.992501 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-99049ef4-8c18-4a5f-a33c-dd23af907145 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:54.018848 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-99049ef4-8c18-4a5f-a33c-dd23af907145 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Going to try to start instance {{(pid=117889) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 28 12:08:54.068252 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-99049ef4-8c18-4a5f-a33c-dd23af907145 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "POST /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/action" status: 202 len: 0 microversion: 2.1 time: 0.100135 Jun 28 12:08:54.070224 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 232/491] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:08:53 2022] POST /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:08:54.081919 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-19c8d4b9-26c2-4d38-9990-830400f0a013 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:54.082894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-19c8d4b9-26c2-4d38-9990-830400f0a013 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:54.089777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19c8d4b9-26c2-4d38-9990-830400f0a013 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:54.090335 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19c8d4b9-26c2-4d38-9990-830400f0a013 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:54.091203 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19c8d4b9-26c2-4d38-9990-830400f0a013 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:54.091702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19c8d4b9-26c2-4d38-9990-830400f0a013 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:54.380730 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-19c8d4b9-26c2-4d38-9990-830400f0a013 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:54.389252 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-19c8d4b9-26c2-4d38-9990-830400f0a013 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1709 microversion: 2.1 time: 0.314270 Jun 28 12:08:54.389868 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 260/492] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:54 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1709 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:54.663990 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5d2a799d-d3cd-40ed-88aa-ce183584d772 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:54.665435 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5d2a799d-d3cd-40ed-88aa-ce183584d772 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:54.672995 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d2a799d-d3cd-40ed-88aa-ce183584d772 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:54.674409 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d2a799d-d3cd-40ed-88aa-ce183584d772 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:54.675948 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d2a799d-d3cd-40ed-88aa-ce183584d772 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:54.676866 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d2a799d-d3cd-40ed-88aa-ce183584d772 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:54.876846 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d2a799d-d3cd-40ed-88aa-ce183584d772 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:54.888085 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d2a799d-d3cd-40ed-88aa-ce183584d772 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:54.889890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d2a799d-d3cd-40ed-88aa-ce183584d772 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:54.892089 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5d2a799d-d3cd-40ed-88aa-ce183584d772 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1739 microversion: 2.20 time: 0.233635 Jun 28 12:08:54.903542 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 233/493] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:54 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:55.407465 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c93e628a-5e2a-4d4e-8352-1f6674e9eb42 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:55.408667 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c93e628a-5e2a-4d4e-8352-1f6674e9eb42 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:55.411883 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=48 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:55.417341 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c93e628a-5e2a-4d4e-8352-1f6674e9eb42 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:55.417790 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c93e628a-5e2a-4d4e-8352-1f6674e9eb42 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:55.418575 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c93e628a-5e2a-4d4e-8352-1f6674e9eb42 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:55.418996 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c93e628a-5e2a-4d4e-8352-1f6674e9eb42 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:55.814882 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c93e628a-5e2a-4d4e-8352-1f6674e9eb42 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:55.823731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c93e628a-5e2a-4d4e-8352-1f6674e9eb42 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1709 microversion: 2.1 time: 0.420342 Jun 28 12:08:55.833870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 261/494] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:55 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1709 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:55.912121 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-132f3146-24df-42b6-8580-aa34c3594551 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:55.912695 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-132f3146-24df-42b6-8580-aa34c3594551 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:55.929376 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-132f3146-24df-42b6-8580-aa34c3594551 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:55.931486 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-132f3146-24df-42b6-8580-aa34c3594551 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:55.935636 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-132f3146-24df-42b6-8580-aa34c3594551 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:55.936081 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-132f3146-24df-42b6-8580-aa34c3594551 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:56.087308 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-132f3146-24df-42b6-8580-aa34c3594551 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:56.096153 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-132f3146-24df-42b6-8580-aa34c3594551 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:56.097960 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-132f3146-24df-42b6-8580-aa34c3594551 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:56.099385 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-132f3146-24df-42b6-8580-aa34c3594551 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1739 microversion: 2.20 time: 0.191499 Jun 28 12:08:56.111476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 234/495] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:55 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:56.842178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-358bde54-86e7-4f2c-aa9a-24a5289d84a2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:56.842833 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-358bde54-86e7-4f2c-aa9a-24a5289d84a2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:56.850202 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-358bde54-86e7-4f2c-aa9a-24a5289d84a2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:56.850621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-358bde54-86e7-4f2c-aa9a-24a5289d84a2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:56.851668 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-358bde54-86e7-4f2c-aa9a-24a5289d84a2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:56.852125 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-358bde54-86e7-4f2c-aa9a-24a5289d84a2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:56.991664 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-358bde54-86e7-4f2c-aa9a-24a5289d84a2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:57.000630 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-358bde54-86e7-4f2c-aa9a-24a5289d84a2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1713 microversion: 2.1 time: 0.162799 Jun 28 12:08:57.001239 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 262/496] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:08:56 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1713 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:08:57.119502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-49d9ecad-6ac6-42e9-845f-da11ab023e6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:57.120748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-49d9ecad-6ac6-42e9-845f-da11ab023e6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:57.128130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49d9ecad-6ac6-42e9-845f-da11ab023e6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:57.128826 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49d9ecad-6ac6-42e9-845f-da11ab023e6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:57.129808 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49d9ecad-6ac6-42e9-845f-da11ab023e6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:57.130410 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49d9ecad-6ac6-42e9-845f-da11ab023e6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:57.275631 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-49d9ecad-6ac6-42e9-845f-da11ab023e6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:57.283952 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-49d9ecad-6ac6-42e9-845f-da11ab023e6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:57.285481 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-49d9ecad-6ac6-42e9-845f-da11ab023e6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:57.286653 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-49d9ecad-6ac6-42e9-845f-da11ab023e6f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1739 microversion: 2.20 time: 0.171384 Jun 28 12:08:57.293939 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 235/497] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:57 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:58.305603 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7d9711d0-337b-463a-80d4-2bde5be1907b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:58.306441 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7d9711d0-337b-463a-80d4-2bde5be1907b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:58.315991 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d9711d0-337b-463a-80d4-2bde5be1907b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:58.316715 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d9711d0-337b-463a-80d4-2bde5be1907b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:58.317718 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d9711d0-337b-463a-80d4-2bde5be1907b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:58.318384 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d9711d0-337b-463a-80d4-2bde5be1907b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:58.470402 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7d9711d0-337b-463a-80d4-2bde5be1907b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:58.479162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7d9711d0-337b-463a-80d4-2bde5be1907b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:58.481445 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7d9711d0-337b-463a-80d4-2bde5be1907b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:58.482618 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7d9711d0-337b-463a-80d4-2bde5be1907b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1739 microversion: 2.20 time: 0.181106 Jun 28 12:08:58.483142 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 263/498] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:58 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:08:59.504102 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c866e832-718a-4b12-96db-92bee406ce5f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:08:59.504890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c866e832-718a-4b12-96db-92bee406ce5f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:08:59.507446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=44 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:59.515073 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c866e832-718a-4b12-96db-92bee406ce5f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:59.515529 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c866e832-718a-4b12-96db-92bee406ce5f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:59.516304 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c866e832-718a-4b12-96db-92bee406ce5f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:08:59.516732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c866e832-718a-4b12-96db-92bee406ce5f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:08:59.660070 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c866e832-718a-4b12-96db-92bee406ce5f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:59.669717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c866e832-718a-4b12-96db-92bee406ce5f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:59.671738 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c866e832-718a-4b12-96db-92bee406ce5f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:08:59.673294 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c866e832-718a-4b12-96db-92bee406ce5f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1739 microversion: 2.20 time: 0.173372 Jun 28 12:08:59.673865 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 236/499] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:08:59 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:00.691919 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f6fdd967-f9f2-45d2-9407-02bc67aa99c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:00.693384 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f6fdd967-f9f2-45d2-9407-02bc67aa99c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:00.703702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6fdd967-f9f2-45d2-9407-02bc67aa99c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:00.704148 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6fdd967-f9f2-45d2-9407-02bc67aa99c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:00.705268 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6fdd967-f9f2-45d2-9407-02bc67aa99c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:00.705702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f6fdd967-f9f2-45d2-9407-02bc67aa99c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:00.846047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f6fdd967-f9f2-45d2-9407-02bc67aa99c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:00.855256 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f6fdd967-f9f2-45d2-9407-02bc67aa99c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:00.856778 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f6fdd967-f9f2-45d2-9407-02bc67aa99c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:00.858012 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f6fdd967-f9f2-45d2-9407-02bc67aa99c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1739 microversion: 2.20 time: 0.169994 Jun 28 12:09:00.859549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 264/500] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:00 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:01.877437 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-53d5eefc-72eb-4b16-a8ef-28fdad47ba9a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:01.879362 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-53d5eefc-72eb-4b16-a8ef-28fdad47ba9a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:01.885193 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53d5eefc-72eb-4b16-a8ef-28fdad47ba9a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:01.885755 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53d5eefc-72eb-4b16-a8ef-28fdad47ba9a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:01.886409 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53d5eefc-72eb-4b16-a8ef-28fdad47ba9a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:01.886836 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53d5eefc-72eb-4b16-a8ef-28fdad47ba9a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:02.026823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-53d5eefc-72eb-4b16-a8ef-28fdad47ba9a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:02.035955 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-53d5eefc-72eb-4b16-a8ef-28fdad47ba9a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:02.037473 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-53d5eefc-72eb-4b16-a8ef-28fdad47ba9a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:02.038633 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-53d5eefc-72eb-4b16-a8ef-28fdad47ba9a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1739 microversion: 2.20 time: 0.165754 Jun 28 12:09:02.045114 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 237/501] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:01 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:03.058057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-329fc000-9636-4339-9d7d-fbcf8502445b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:03.058705 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-329fc000-9636-4339-9d7d-fbcf8502445b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:03.066302 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-329fc000-9636-4339-9d7d-fbcf8502445b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:03.066742 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-329fc000-9636-4339-9d7d-fbcf8502445b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:03.067768 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-329fc000-9636-4339-9d7d-fbcf8502445b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:03.068388 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-329fc000-9636-4339-9d7d-fbcf8502445b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:03.213902 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-329fc000-9636-4339-9d7d-fbcf8502445b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:03.225602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-329fc000-9636-4339-9d7d-fbcf8502445b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:03.228010 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-329fc000-9636-4339-9d7d-fbcf8502445b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:03.229637 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-329fc000-9636-4339-9d7d-fbcf8502445b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1739 microversion: 2.20 time: 0.175360 Jun 28 12:09:03.230427 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 265/502] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:03 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:04.252764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c4e708c3-d479-48e6-8b5e-47bcc683e5e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:04.253412 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c4e708c3-d479-48e6-8b5e-47bcc683e5e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:04.260449 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4e708c3-d479-48e6-8b5e-47bcc683e5e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:04.260922 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4e708c3-d479-48e6-8b5e-47bcc683e5e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:04.261723 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4e708c3-d479-48e6-8b5e-47bcc683e5e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:04.262163 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4e708c3-d479-48e6-8b5e-47bcc683e5e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:04.396486 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4e708c3-d479-48e6-8b5e-47bcc683e5e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:04.405037 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4e708c3-d479-48e6-8b5e-47bcc683e5e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:04.406499 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4e708c3-d479-48e6-8b5e-47bcc683e5e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:04.407764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c4e708c3-d479-48e6-8b5e-47bcc683e5e1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1721 microversion: 2.20 time: 0.161211 Jun 28 12:09:04.408550 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 238/503] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:04 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:05.430946 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-20ac8cf2-50e2-4e37-8603-5e4104be9c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:05.431954 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-20ac8cf2-50e2-4e37-8603-5e4104be9c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:05.441300 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-20ac8cf2-50e2-4e37-8603-5e4104be9c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:05.441747 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-20ac8cf2-50e2-4e37-8603-5e4104be9c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:05.442512 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-20ac8cf2-50e2-4e37-8603-5e4104be9c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:05.442932 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-20ac8cf2-50e2-4e37-8603-5e4104be9c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:05.581003 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-20ac8cf2-50e2-4e37-8603-5e4104be9c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:05.589676 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-20ac8cf2-50e2-4e37-8603-5e4104be9c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:05.591173 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-20ac8cf2-50e2-4e37-8603-5e4104be9c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:05.592341 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-20ac8cf2-50e2-4e37-8603-5e4104be9c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1721 microversion: 2.20 time: 0.168069 Jun 28 12:09:05.592898 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 266/504] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:05 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:09:06.620438 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b4fd802f-61f7-47ae-ac29-81613a829e9c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:06.621424 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b4fd802f-61f7-47ae-ac29-81613a829e9c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:06.629979 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4fd802f-61f7-47ae-ac29-81613a829e9c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:06.630407 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4fd802f-61f7-47ae-ac29-81613a829e9c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:06.631152 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4fd802f-61f7-47ae-ac29-81613a829e9c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:06.631581 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b4fd802f-61f7-47ae-ac29-81613a829e9c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:06.768850 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b4fd802f-61f7-47ae-ac29-81613a829e9c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:06.779939 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b4fd802f-61f7-47ae-ac29-81613a829e9c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:06.781442 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b4fd802f-61f7-47ae-ac29-81613a829e9c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:06.782732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b4fd802f-61f7-47ae-ac29-81613a829e9c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1721 microversion: 2.20 time: 0.168797 Jun 28 12:09:06.783378 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 239/505] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:06 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:07.684703 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-5de9e80a-d474-4a9d-a0bd-5f208e6be447 req-9bc0db6d-dfbd-407e-a32f-964a0a53e05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350964d7-7d2a-4335-b45e-c50e8cd87f7d", "name": "network-vif-unplugged", "status": "completed", "tag": "5f8ebf1b-007a-4caf-9a83-c43616b46917"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:09:07.694469 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5de9e80a-d474-4a9d-a0bd-5f208e6be447 req-9bc0db6d-dfbd-407e-a32f-964a0a53e05f service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:07.694946 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-5de9e80a-d474-4a9d-a0bd-5f208e6be447 req-9bc0db6d-dfbd-407e-a32f-964a0a53e05f service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:07.707713 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.compute.server_external_events [req-5de9e80a-d474-4a9d-a0bd-5f208e6be447 req-9bc0db6d-dfbd-407e-a32f-964a0a53e05f service nova] Unable to find a host for instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d. Dropping event network-vif-unplugged {{(pid=117888) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 28 12:09:07.708594 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-5de9e80a-d474-4a9d-a0bd-5f208e6be447 req-9bc0db6d-dfbd-407e-a32f-964a0a53e05f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027854 Jun 28 12:09:07.709212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 267/506] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 28 12:09:07.801798 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bf002e23-436f-44c4-a3bf-7605e7d07937 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:07.802428 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bf002e23-436f-44c4-a3bf-7605e7d07937 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:07.809517 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf002e23-436f-44c4-a3bf-7605e7d07937 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:07.809972 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf002e23-436f-44c4-a3bf-7605e7d07937 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:07.810740 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf002e23-436f-44c4-a3bf-7605e7d07937 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:07.811184 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bf002e23-436f-44c4-a3bf-7605e7d07937 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:07.947610 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf002e23-436f-44c4-a3bf-7605e7d07937 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:07.956047 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf002e23-436f-44c4-a3bf-7605e7d07937 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:07.957691 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bf002e23-436f-44c4-a3bf-7605e7d07937 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:07.958849 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bf002e23-436f-44c4-a3bf-7605e7d07937 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1664 microversion: 2.20 time: 0.161191 Jun 28 12:09:07.959412 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 240/507] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:07 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:07.977217 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1c27e0f1-45a8-4a2e-841e-cf0dfe6347dc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "970c6284-82d0-46db-89ca-470534ad6ec2"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:09:07.978288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1c27e0f1-45a8-4a2e-841e-cf0dfe6347dc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:07.984417 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1c27e0f1-45a8-4a2e-841e-cf0dfe6347dc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:07.985040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1c27e0f1-45a8-4a2e-841e-cf0dfe6347dc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:07.985801 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1c27e0f1-45a8-4a2e-841e-cf0dfe6347dc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:07.986240 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1c27e0f1-45a8-4a2e-841e-cf0dfe6347dc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:08.282563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:09:08.301622 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1c27e0f1-45a8-4a2e-841e-cf0dfe6347dc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "POST /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.328495 Jun 28 12:09:08.306933 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 268/508] 10.222.0.55 () {62 vars in 1363 bytes} [Tue Jun 28 12:09:07 2022] POST /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments => generated 188 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 28 12:09:08.424017 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-09e42836-2529-4f68-a82e-7dc170bf7c2a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:09:08.424585 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-09e42836-2529-4f68-a82e-7dc170bf7c2a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:08.430983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09e42836-2529-4f68-a82e-7dc170bf7c2a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:08.431433 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09e42836-2529-4f68-a82e-7dc170bf7c2a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:08.432192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09e42836-2529-4f68-a82e-7dc170bf7c2a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:08.432625 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09e42836-2529-4f68-a82e-7dc170bf7c2a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:08.537255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-09e42836-2529-4f68-a82e-7dc170bf7c2a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "POST /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/action" status: 202 len: 0 microversion: 2.20 time: 0.116938 Jun 28 12:09:08.538067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 241/509] 10.222.0.55 () {62 vars in 1318 bytes} [Tue Jun 28 12:09:08 2022] POST /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:09:08.546509 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c17a311b-7b9d-4e7b-afca-d28231144c4a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:08.547126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c17a311b-7b9d-4e7b-afca-d28231144c4a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:08.554093 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c17a311b-7b9d-4e7b-afca-d28231144c4a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:08.554543 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c17a311b-7b9d-4e7b-afca-d28231144c4a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:08.555320 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c17a311b-7b9d-4e7b-afca-d28231144c4a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:08.555748 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c17a311b-7b9d-4e7b-afca-d28231144c4a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:08.695920 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c17a311b-7b9d-4e7b-afca-d28231144c4a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:08.705619 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c17a311b-7b9d-4e7b-afca-d28231144c4a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:08.707118 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c17a311b-7b9d-4e7b-afca-d28231144c4a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:08.708303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c17a311b-7b9d-4e7b-afca-d28231144c4a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1750 microversion: 2.20 time: 0.166057 Jun 28 12:09:08.708853 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 269/510] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:08 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:09.728411 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2993e049-6aed-4b97-abbb-9f7c60d89fb1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:09.729157 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2993e049-6aed-4b97-abbb-9f7c60d89fb1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:09.736747 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2993e049-6aed-4b97-abbb-9f7c60d89fb1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:09.737309 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2993e049-6aed-4b97-abbb-9f7c60d89fb1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:09.738138 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2993e049-6aed-4b97-abbb-9f7c60d89fb1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:09.738635 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2993e049-6aed-4b97-abbb-9f7c60d89fb1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:09.743475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:09:09.873215 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2993e049-6aed-4b97-abbb-9f7c60d89fb1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:09.882461 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2993e049-6aed-4b97-abbb-9f7c60d89fb1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:09.883972 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2993e049-6aed-4b97-abbb-9f7c60d89fb1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:09.885155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2993e049-6aed-4b97-abbb-9f7c60d89fb1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1752 microversion: 2.20 time: 0.160931 Jun 28 12:09:09.885744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 242/511] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:09 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:10.909072 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-26d5842f-e44a-4a77-900d-44a34db14290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:10.910071 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-26d5842f-e44a-4a77-900d-44a34db14290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:10.921224 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-26d5842f-e44a-4a77-900d-44a34db14290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:10.921964 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-26d5842f-e44a-4a77-900d-44a34db14290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:10.923332 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-26d5842f-e44a-4a77-900d-44a34db14290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:10.923761 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-26d5842f-e44a-4a77-900d-44a34db14290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:11.066578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-26d5842f-e44a-4a77-900d-44a34db14290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:11.075099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-26d5842f-e44a-4a77-900d-44a34db14290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:11.076609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-26d5842f-e44a-4a77-900d-44a34db14290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:11.077805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-26d5842f-e44a-4a77-900d-44a34db14290 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.175871 Jun 28 12:09:11.078589 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 270/512] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:10 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:12.097375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-42160602-7237-439b-b2db-16aea0b0ac0f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:12.098019 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-42160602-7237-439b-b2db-16aea0b0ac0f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:12.105199 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42160602-7237-439b-b2db-16aea0b0ac0f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:12.105658 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42160602-7237-439b-b2db-16aea0b0ac0f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:12.106433 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42160602-7237-439b-b2db-16aea0b0ac0f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:12.106867 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-42160602-7237-439b-b2db-16aea0b0ac0f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:12.272691 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-42160602-7237-439b-b2db-16aea0b0ac0f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:12.289006 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-42160602-7237-439b-b2db-16aea0b0ac0f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:12.291025 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-42160602-7237-439b-b2db-16aea0b0ac0f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:12.292674 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-42160602-7237-439b-b2db-16aea0b0ac0f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.199743 Jun 28 12:09:12.294067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 243/513] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:12 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:13.312051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-029354c9-618b-458f-93ba-385d5a58b3e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:13.312693 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-029354c9-618b-458f-93ba-385d5a58b3e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:13.320229 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-029354c9-618b-458f-93ba-385d5a58b3e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:13.320563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-029354c9-618b-458f-93ba-385d5a58b3e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:13.321405 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-029354c9-618b-458f-93ba-385d5a58b3e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:13.321839 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-029354c9-618b-458f-93ba-385d5a58b3e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:13.466021 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-029354c9-618b-458f-93ba-385d5a58b3e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:13.475659 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-029354c9-618b-458f-93ba-385d5a58b3e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:13.477324 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-029354c9-618b-458f-93ba-385d5a58b3e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:13.478540 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-029354c9-618b-458f-93ba-385d5a58b3e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.170516 Jun 28 12:09:13.479099 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 271/514] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:13 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:14.500375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4dcb2682-6eec-4467-8509-5205aff77f67 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:14.501132 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4dcb2682-6eec-4467-8509-5205aff77f67 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:14.508123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dcb2682-6eec-4467-8509-5205aff77f67 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:14.508581 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dcb2682-6eec-4467-8509-5205aff77f67 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:14.509388 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dcb2682-6eec-4467-8509-5205aff77f67 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:14.509828 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dcb2682-6eec-4467-8509-5205aff77f67 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:14.653246 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4dcb2682-6eec-4467-8509-5205aff77f67 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:14.665972 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4dcb2682-6eec-4467-8509-5205aff77f67 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:14.667456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4dcb2682-6eec-4467-8509-5205aff77f67 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:14.668615 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4dcb2682-6eec-4467-8509-5205aff77f67 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.172584 Jun 28 12:09:14.669200 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 244/515] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:14 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:15.687747 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9d98da91-103b-4119-990b-cdc9df4c62ed tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:15.688371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9d98da91-103b-4119-990b-cdc9df4c62ed tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:15.695410 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d98da91-103b-4119-990b-cdc9df4c62ed tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:15.695895 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d98da91-103b-4119-990b-cdc9df4c62ed tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:15.696651 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d98da91-103b-4119-990b-cdc9df4c62ed tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:15.697134 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d98da91-103b-4119-990b-cdc9df4c62ed tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:15.834935 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9d98da91-103b-4119-990b-cdc9df4c62ed tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:15.844079 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9d98da91-103b-4119-990b-cdc9df4c62ed tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:15.845611 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9d98da91-103b-4119-990b-cdc9df4c62ed tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:15.846776 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9d98da91-103b-4119-990b-cdc9df4c62ed tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.163145 Jun 28 12:09:15.847379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 272/516] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:15 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:16.867930 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d780c457-0301-4e4b-a1cb-1a1785546768 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:16.869164 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d780c457-0301-4e4b-a1cb-1a1785546768 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:16.877518 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d780c457-0301-4e4b-a1cb-1a1785546768 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:16.878224 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d780c457-0301-4e4b-a1cb-1a1785546768 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:16.879394 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d780c457-0301-4e4b-a1cb-1a1785546768 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:16.880027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d780c457-0301-4e4b-a1cb-1a1785546768 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:17.020982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d780c457-0301-4e4b-a1cb-1a1785546768 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:17.030383 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d780c457-0301-4e4b-a1cb-1a1785546768 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:17.031831 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d780c457-0301-4e4b-a1cb-1a1785546768 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:17.033061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d780c457-0301-4e4b-a1cb-1a1785546768 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.170839 Jun 28 12:09:17.033981 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 245/517] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:16 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:18.052129 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-35ab1910-8ebb-4839-86c1-6cfbaf0f684c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:18.052756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-35ab1910-8ebb-4839-86c1-6cfbaf0f684c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:18.059452 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-35ab1910-8ebb-4839-86c1-6cfbaf0f684c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:18.059894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-35ab1910-8ebb-4839-86c1-6cfbaf0f684c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:18.060644 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-35ab1910-8ebb-4839-86c1-6cfbaf0f684c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:18.061109 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-35ab1910-8ebb-4839-86c1-6cfbaf0f684c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:18.197558 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-35ab1910-8ebb-4839-86c1-6cfbaf0f684c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:18.206862 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-35ab1910-8ebb-4839-86c1-6cfbaf0f684c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:18.208683 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-35ab1910-8ebb-4839-86c1-6cfbaf0f684c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:18.209910 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-35ab1910-8ebb-4839-86c1-6cfbaf0f684c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.161933 Jun 28 12:09:18.210862 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 273/518] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:18 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:18.550876 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d2e397d3-2b16-4937-920c-505fffb3dc03 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70f141ee-b47f-413d-9dba-443819e9365f"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:09:18.552248 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d2e397d3-2b16-4937-920c-505fffb3dc03 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:18.560335 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2e397d3-2b16-4937-920c-505fffb3dc03 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:18.560919 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2e397d3-2b16-4937-920c-505fffb3dc03 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:18.561811 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2e397d3-2b16-4937-920c-505fffb3dc03 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:18.562244 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2e397d3-2b16-4937-920c-505fffb3dc03 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:19.229620 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ebcfd13c-fe0f-4577-9310-c3721cb8ddfb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:19.230470 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ebcfd13c-fe0f-4577-9310-c3721cb8ddfb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:19.237551 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebcfd13c-fe0f-4577-9310-c3721cb8ddfb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:19.237992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebcfd13c-fe0f-4577-9310-c3721cb8ddfb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:19.238755 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebcfd13c-fe0f-4577-9310-c3721cb8ddfb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:19.239181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebcfd13c-fe0f-4577-9310-c3721cb8ddfb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:19.385250 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ebcfd13c-fe0f-4577-9310-c3721cb8ddfb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:19.397827 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ebcfd13c-fe0f-4577-9310-c3721cb8ddfb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:19.399885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ebcfd13c-fe0f-4577-9310-c3721cb8ddfb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:19.401220 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ebcfd13c-fe0f-4577-9310-c3721cb8ddfb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.176090 Jun 28 12:09:19.401794 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 274/519] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:19 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:20.421156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-887e496b-6f07-4ee0-92da-50d42cdc757e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:20.422565 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-887e496b-6f07-4ee0-92da-50d42cdc757e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:20.429137 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-887e496b-6f07-4ee0-92da-50d42cdc757e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:20.429578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-887e496b-6f07-4ee0-92da-50d42cdc757e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:20.430607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-887e496b-6f07-4ee0-92da-50d42cdc757e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:20.431732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-887e496b-6f07-4ee0-92da-50d42cdc757e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:20.566663 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-887e496b-6f07-4ee0-92da-50d42cdc757e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:20.576490 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-887e496b-6f07-4ee0-92da-50d42cdc757e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:20.578000 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-887e496b-6f07-4ee0-92da-50d42cdc757e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:20.579176 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-887e496b-6f07-4ee0-92da-50d42cdc757e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.162518 Jun 28 12:09:20.579708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 275/520] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:20 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:09:21.598236 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-34f87de8-7a32-4e83-8ded-835f7f4b51e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:21.598978 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-34f87de8-7a32-4e83-8ded-835f7f4b51e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:21.606376 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34f87de8-7a32-4e83-8ded-835f7f4b51e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:21.607114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34f87de8-7a32-4e83-8ded-835f7f4b51e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:21.607896 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34f87de8-7a32-4e83-8ded-835f7f4b51e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:21.608316 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-34f87de8-7a32-4e83-8ded-835f7f4b51e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:21.747875 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-34f87de8-7a32-4e83-8ded-835f7f4b51e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:21.757610 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-34f87de8-7a32-4e83-8ded-835f7f4b51e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:21.759248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-34f87de8-7a32-4e83-8ded-835f7f4b51e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:21.760439 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-34f87de8-7a32-4e83-8ded-835f7f4b51e4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.166233 Jun 28 12:09:21.761013 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 276/521] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:21 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:22.779444 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4ffae669-da12-45ed-8e3e-5f0317fbae93 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:22.780167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4ffae669-da12-45ed-8e3e-5f0317fbae93 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:22.787262 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4ffae669-da12-45ed-8e3e-5f0317fbae93 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:22.787726 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4ffae669-da12-45ed-8e3e-5f0317fbae93 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:22.788510 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4ffae669-da12-45ed-8e3e-5f0317fbae93 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:22.788954 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4ffae669-da12-45ed-8e3e-5f0317fbae93 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:22.926971 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4ffae669-da12-45ed-8e3e-5f0317fbae93 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:22.937297 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4ffae669-da12-45ed-8e3e-5f0317fbae93 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:22.938805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4ffae669-da12-45ed-8e3e-5f0317fbae93 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:22.939983 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4ffae669-da12-45ed-8e3e-5f0317fbae93 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.164541 Jun 28 12:09:22.940546 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 277/522] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:22 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:23.958854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ffb879cc-4d8a-4687-ac81-b0479bda7dae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:23.959553 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ffb879cc-4d8a-4687-ac81-b0479bda7dae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:23.967267 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffb879cc-4d8a-4687-ac81-b0479bda7dae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:23.967887 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffb879cc-4d8a-4687-ac81-b0479bda7dae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:23.969072 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffb879cc-4d8a-4687-ac81-b0479bda7dae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:23.969671 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffb879cc-4d8a-4687-ac81-b0479bda7dae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:24.107913 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ffb879cc-4d8a-4687-ac81-b0479bda7dae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:24.117130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ffb879cc-4d8a-4687-ac81-b0479bda7dae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:24.118994 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ffb879cc-4d8a-4687-ac81-b0479bda7dae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:24.120158 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ffb879cc-4d8a-4687-ac81-b0479bda7dae tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.165324 Jun 28 12:09:24.121004 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 278/523] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:23 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:25.141216 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ff86a953-d3de-4433-9852-ef93d709a649 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:25.142248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ff86a953-d3de-4433-9852-ef93d709a649 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:25.148766 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff86a953-d3de-4433-9852-ef93d709a649 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:25.149259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff86a953-d3de-4433-9852-ef93d709a649 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:25.150503 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff86a953-d3de-4433-9852-ef93d709a649 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:25.150957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff86a953-d3de-4433-9852-ef93d709a649 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:25.352366 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ff86a953-d3de-4433-9852-ef93d709a649 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:25.365516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ff86a953-d3de-4433-9852-ef93d709a649 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:25.367625 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ff86a953-d3de-4433-9852-ef93d709a649 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:25.369212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ff86a953-d3de-4433-9852-ef93d709a649 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.232549 Jun 28 12:09:25.369765 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 279/524] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:25 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:09:26.389410 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3ef94581-dc54-4345-aac7-e84b7798d30c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:26.390136 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3ef94581-dc54-4345-aac7-e84b7798d30c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:26.392476 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=38 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:09:26.398337 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ef94581-dc54-4345-aac7-e84b7798d30c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:26.398791 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ef94581-dc54-4345-aac7-e84b7798d30c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:26.399579 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ef94581-dc54-4345-aac7-e84b7798d30c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:26.400036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ef94581-dc54-4345-aac7-e84b7798d30c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:26.537953 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3ef94581-dc54-4345-aac7-e84b7798d30c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:26.546877 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3ef94581-dc54-4345-aac7-e84b7798d30c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:26.548387 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3ef94581-dc54-4345-aac7-e84b7798d30c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:26.549620 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3ef94581-dc54-4345-aac7-e84b7798d30c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.164787 Jun 28 12:09:26.550175 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 280/525] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:26 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:27.568093 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d09a2774-317f-49e7-8bdb-baf015feb1bf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:27.568805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d09a2774-317f-49e7-8bdb-baf015feb1bf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:27.576035 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d09a2774-317f-49e7-8bdb-baf015feb1bf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:27.576480 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d09a2774-317f-49e7-8bdb-baf015feb1bf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:27.577349 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d09a2774-317f-49e7-8bdb-baf015feb1bf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:27.577778 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d09a2774-317f-49e7-8bdb-baf015feb1bf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:27.729917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d09a2774-317f-49e7-8bdb-baf015feb1bf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:27.738493 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d09a2774-317f-49e7-8bdb-baf015feb1bf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:27.740095 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d09a2774-317f-49e7-8bdb-baf015feb1bf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:27.741370 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d09a2774-317f-49e7-8bdb-baf015feb1bf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.177397 Jun 28 12:09:27.742003 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 281/526] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:27 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:09:27.898308 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d2e397d3-2b16-4937-920c-505fffb3dc03 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "POST /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.350977 Jun 28 12:09:27.898967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 246/527] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:09:18 2022] POST /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments => generated 194 bytes in 9353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:09:28.763663 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-102a7a3e-dc38-457d-8671-4c18db5e77e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:28.764455 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-102a7a3e-dc38-457d-8671-4c18db5e77e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:28.772591 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-102a7a3e-dc38-457d-8671-4c18db5e77e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:28.773340 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-102a7a3e-dc38-457d-8671-4c18db5e77e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:28.774071 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-102a7a3e-dc38-457d-8671-4c18db5e77e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:28.774585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-102a7a3e-dc38-457d-8671-4c18db5e77e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:28.918191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-102a7a3e-dc38-457d-8671-4c18db5e77e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:28.926766 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-102a7a3e-dc38-457d-8671-4c18db5e77e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:28.928271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-102a7a3e-dc38-457d-8671-4c18db5e77e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:28.929487 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-102a7a3e-dc38-457d-8671-4c18db5e77e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.171325 Jun 28 12:09:28.930040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 282/528] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:28 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:29.952833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-44d2b3cb-31e0-4266-b65f-eeef0ca5ae19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:29.953849 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-44d2b3cb-31e0-4266-b65f-eeef0ca5ae19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:29.957919 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=23 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:09:29.966528 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44d2b3cb-31e0-4266-b65f-eeef0ca5ae19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:29.966988 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44d2b3cb-31e0-4266-b65f-eeef0ca5ae19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:29.967758 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44d2b3cb-31e0-4266-b65f-eeef0ca5ae19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:29.968196 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44d2b3cb-31e0-4266-b65f-eeef0ca5ae19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:30.107226 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44d2b3cb-31e0-4266-b65f-eeef0ca5ae19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:30.115855 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44d2b3cb-31e0-4266-b65f-eeef0ca5ae19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:30.117430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44d2b3cb-31e0-4266-b65f-eeef0ca5ae19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:30.118599 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-44d2b3cb-31e0-4266-b65f-eeef0ca5ae19 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.173041 Jun 28 12:09:30.119169 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 247/529] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:29 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:31.137142 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-08a1dc70-7697-4da1-807d-3ebeac47e9fe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:31.137785 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-08a1dc70-7697-4da1-807d-3ebeac47e9fe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:31.144531 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08a1dc70-7697-4da1-807d-3ebeac47e9fe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:31.144981 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08a1dc70-7697-4da1-807d-3ebeac47e9fe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:31.145995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08a1dc70-7697-4da1-807d-3ebeac47e9fe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:31.146413 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08a1dc70-7697-4da1-807d-3ebeac47e9fe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:31.290397 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-08a1dc70-7697-4da1-807d-3ebeac47e9fe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:31.303385 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-08a1dc70-7697-4da1-807d-3ebeac47e9fe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:31.305630 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-08a1dc70-7697-4da1-807d-3ebeac47e9fe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:31.307356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-08a1dc70-7697-4da1-807d-3ebeac47e9fe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.173835 Jun 28 12:09:31.308354 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 283/530] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:31 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:32.328793 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b1e8016b-25b1-4e30-9d95-84ee4177945c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:32.329647 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b1e8016b-25b1-4e30-9d95-84ee4177945c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:32.339495 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1e8016b-25b1-4e30-9d95-84ee4177945c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:32.340131 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1e8016b-25b1-4e30-9d95-84ee4177945c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:32.341418 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1e8016b-25b1-4e30-9d95-84ee4177945c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:32.342056 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1e8016b-25b1-4e30-9d95-84ee4177945c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:32.484481 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b1e8016b-25b1-4e30-9d95-84ee4177945c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:32.498027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b1e8016b-25b1-4e30-9d95-84ee4177945c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:32.500346 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b1e8016b-25b1-4e30-9d95-84ee4177945c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:32.502111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b1e8016b-25b1-4e30-9d95-84ee4177945c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.178076 Jun 28 12:09:32.502890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 248/531] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:32 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:33.527387 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6c88abc8-e2b1-469f-84aa-b8867fe83144 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:33.528118 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6c88abc8-e2b1-469f-84aa-b8867fe83144 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:33.537379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c88abc8-e2b1-469f-84aa-b8867fe83144 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:33.539634 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c88abc8-e2b1-469f-84aa-b8867fe83144 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:33.540411 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c88abc8-e2b1-469f-84aa-b8867fe83144 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:33.540850 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c88abc8-e2b1-469f-84aa-b8867fe83144 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:33.679129 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6c88abc8-e2b1-469f-84aa-b8867fe83144 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:33.683834 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:09:33.689490 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6c88abc8-e2b1-469f-84aa-b8867fe83144 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:33.690991 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6c88abc8-e2b1-469f-84aa-b8867fe83144 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:33.692172 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6c88abc8-e2b1-469f-84aa-b8867fe83144 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.170881 Jun 28 12:09:33.692727 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 284/532] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:33 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:34.715006 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-41efb80d-8c56-4bf2-a7ef-3b38655a0f8d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:34.715944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-41efb80d-8c56-4bf2-a7ef-3b38655a0f8d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:34.726074 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41efb80d-8c56-4bf2-a7ef-3b38655a0f8d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:34.726765 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41efb80d-8c56-4bf2-a7ef-3b38655a0f8d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:34.727912 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41efb80d-8c56-4bf2-a7ef-3b38655a0f8d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:34.728584 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41efb80d-8c56-4bf2-a7ef-3b38655a0f8d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:34.875855 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-41efb80d-8c56-4bf2-a7ef-3b38655a0f8d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:34.884963 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-41efb80d-8c56-4bf2-a7ef-3b38655a0f8d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:34.886791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-41efb80d-8c56-4bf2-a7ef-3b38655a0f8d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:34.899384 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-41efb80d-8c56-4bf2-a7ef-3b38655a0f8d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.191384 Jun 28 12:09:34.900325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 249/533] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:34 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:35.918923 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-489fd5ca-cc46-4b23-9564-2ee64e0748e6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:35.919758 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-489fd5ca-cc46-4b23-9564-2ee64e0748e6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:35.929453 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-489fd5ca-cc46-4b23-9564-2ee64e0748e6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:35.929906 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-489fd5ca-cc46-4b23-9564-2ee64e0748e6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:35.930677 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-489fd5ca-cc46-4b23-9564-2ee64e0748e6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:35.931109 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-489fd5ca-cc46-4b23-9564-2ee64e0748e6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:36.066001 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-489fd5ca-cc46-4b23-9564-2ee64e0748e6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:36.074840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-489fd5ca-cc46-4b23-9564-2ee64e0748e6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:36.076333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-489fd5ca-cc46-4b23-9564-2ee64e0748e6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:36.077527 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-489fd5ca-cc46-4b23-9564-2ee64e0748e6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.162707 Jun 28 12:09:36.078093 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 285/534] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:35 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:37.103349 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-db2ea063-223c-4f8f-a312-4a7337605490 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:37.103978 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-db2ea063-223c-4f8f-a312-4a7337605490 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:37.110526 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db2ea063-223c-4f8f-a312-4a7337605490 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:37.110984 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db2ea063-223c-4f8f-a312-4a7337605490 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:37.111750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db2ea063-223c-4f8f-a312-4a7337605490 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:37.112187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db2ea063-223c-4f8f-a312-4a7337605490 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:37.250511 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db2ea063-223c-4f8f-a312-4a7337605490 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:37.263866 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db2ea063-223c-4f8f-a312-4a7337605490 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:37.266341 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-db2ea063-223c-4f8f-a312-4a7337605490 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:37.268169 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-db2ea063-223c-4f8f-a312-4a7337605490 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.169017 Jun 28 12:09:37.269255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 250/535] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:37 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:38.024762 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-ac6ab5c0-e567-4d1a-8056-2a59b2a568c9 req-9b31b423-6b1c-4a50-b757-3372f34c20a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350964d7-7d2a-4335-b45e-c50e8cd87f7d", "name": "network-vif-plugged", "status": "completed", "tag": "5f8ebf1b-007a-4caf-9a83-c43616b46917"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:09:38.035934 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-ac6ab5c0-e567-4d1a-8056-2a59b2a568c9 req-9b31b423-6b1c-4a50-b757-3372f34c20a5 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:38.037039 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-ac6ab5c0-e567-4d1a-8056-2a59b2a568c9 req-9b31b423-6b1c-4a50-b757-3372f34c20a5 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:38.048771 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-ac6ab5c0-e567-4d1a-8056-2a59b2a568c9 req-9b31b423-6b1c-4a50-b757-3372f34c20a5 service nova] Creating event network-vif-plugged:5f8ebf1b-007a-4caf-9a83-c43616b46917 for instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d on hv-cinder-84795 Jun 28 12:09:38.053971 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-ac6ab5c0-e567-4d1a-8056-2a59b2a568c9 req-9b31b423-6b1c-4a50-b757-3372f34c20a5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032888 Jun 28 12:09:38.054999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 286/536] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:09:38.415565 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4ba3c93d-4f3a-4612-b3d6-32b59be10c98 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:38.416177 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4ba3c93d-4f3a-4612-b3d6-32b59be10c98 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:38.422562 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ba3c93d-4f3a-4612-b3d6-32b59be10c98 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:38.423016 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ba3c93d-4f3a-4612-b3d6-32b59be10c98 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:38.423774 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ba3c93d-4f3a-4612-b3d6-32b59be10c98 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:38.424207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ba3c93d-4f3a-4612-b3d6-32b59be10c98 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:38.567718 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4ba3c93d-4f3a-4612-b3d6-32b59be10c98 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:38.577221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4ba3c93d-4f3a-4612-b3d6-32b59be10c98 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:38.578718 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4ba3c93d-4f3a-4612-b3d6-32b59be10c98 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:38.579880 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4ba3c93d-4f3a-4612-b3d6-32b59be10c98 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.291772 Jun 28 12:09:38.580427 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 251/537] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:38 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:38.743630 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-904c5ff6-d266-4860-bf45-8a0bbc5cb3a8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:09:38.744638 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-904c5ff6-d266-4860-bf45-8a0bbc5cb3a8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:38.751670 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-904c5ff6-d266-4860-bf45-8a0bbc5cb3a8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:38.752109 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-904c5ff6-d266-4860-bf45-8a0bbc5cb3a8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:38.752854 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-904c5ff6-d266-4860-bf45-8a0bbc5cb3a8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:38.753304 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-904c5ff6-d266-4860-bf45-8a0bbc5cb3a8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:38.775720 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-904c5ff6-d266-4860-bf45-8a0bbc5cb3a8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lazy-loading 'flavor' on Instance uuid 820e4864-70b5-4a7e-bd0a-b33670b86066 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:09:38.907957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-904c5ff6-d266-4860-bf45-8a0bbc5cb3a8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "POST /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/action" status: 200 len: 32 microversion: 2.1 time: 0.168723 Jun 28 12:09:38.908563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 287/538] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:09:38 2022] POST /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 12:09:38.917800 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-63236d5f-67a2-40d1-aadc-973081d44408 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:38.918409 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-63236d5f-67a2-40d1-aadc-973081d44408 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:38.924802 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63236d5f-67a2-40d1-aadc-973081d44408 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:38.925322 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63236d5f-67a2-40d1-aadc-973081d44408 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:38.926112 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63236d5f-67a2-40d1-aadc-973081d44408 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:38.926538 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63236d5f-67a2-40d1-aadc-973081d44408 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:39.067192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-63236d5f-67a2-40d1-aadc-973081d44408 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:39.075390 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-63236d5f-67a2-40d1-aadc-973081d44408 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.161382 Jun 28 12:09:39.076003 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 252/539] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:38 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:09:39.601005 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-113f6275-4d41-41fd-b04c-577d41cd00ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:39.601726 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-113f6275-4d41-41fd-b04c-577d41cd00ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:39.608335 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-113f6275-4d41-41fd-b04c-577d41cd00ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:39.608784 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-113f6275-4d41-41fd-b04c-577d41cd00ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:39.609569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-113f6275-4d41-41fd-b04c-577d41cd00ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:39.609997 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-113f6275-4d41-41fd-b04c-577d41cd00ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:39.762163 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-113f6275-4d41-41fd-b04c-577d41cd00ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:39.771703 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-113f6275-4d41-41fd-b04c-577d41cd00ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:39.773249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-113f6275-4d41-41fd-b04c-577d41cd00ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:39.774417 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-113f6275-4d41-41fd-b04c-577d41cd00ec tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.178305 Jun 28 12:09:39.774974 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 288/540] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:39 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:40.092787 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d74b7d48-dcd9-470e-ae4a-a982850db206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:40.093392 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d74b7d48-dcd9-470e-ae4a-a982850db206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:40.100287 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d74b7d48-dcd9-470e-ae4a-a982850db206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:40.100741 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d74b7d48-dcd9-470e-ae4a-a982850db206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:40.101604 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d74b7d48-dcd9-470e-ae4a-a982850db206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:40.102050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d74b7d48-dcd9-470e-ae4a-a982850db206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:40.104638 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:09:40.248125 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d74b7d48-dcd9-470e-ae4a-a982850db206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:40.256395 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d74b7d48-dcd9-470e-ae4a-a982850db206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.167707 Jun 28 12:09:40.256983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 253/541] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:40 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:40.793454 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ab22193b-59a8-4415-a4e1-ed4d2e4df29c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:40.794170 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ab22193b-59a8-4415-a4e1-ed4d2e4df29c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:40.801477 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab22193b-59a8-4415-a4e1-ed4d2e4df29c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:40.801918 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab22193b-59a8-4415-a4e1-ed4d2e4df29c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:40.802692 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab22193b-59a8-4415-a4e1-ed4d2e4df29c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:40.803136 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab22193b-59a8-4415-a4e1-ed4d2e4df29c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:40.947806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ab22193b-59a8-4415-a4e1-ed4d2e4df29c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:40.957051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ab22193b-59a8-4415-a4e1-ed4d2e4df29c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:40.958563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ab22193b-59a8-4415-a4e1-ed4d2e4df29c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:40.959758 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ab22193b-59a8-4415-a4e1-ed4d2e4df29c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1808 microversion: 2.20 time: 0.170688 Jun 28 12:09:40.960329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 289/542] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:40 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:41.278728 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f04cb213-602e-4a77-a4d0-e9ab6cab144d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:41.279756 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f04cb213-602e-4a77-a4d0-e9ab6cab144d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:41.290761 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f04cb213-602e-4a77-a4d0-e9ab6cab144d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:41.291518 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f04cb213-602e-4a77-a4d0-e9ab6cab144d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:41.292783 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f04cb213-602e-4a77-a4d0-e9ab6cab144d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:41.293572 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f04cb213-602e-4a77-a4d0-e9ab6cab144d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:41.446744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f04cb213-602e-4a77-a4d0-e9ab6cab144d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:41.455281 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f04cb213-602e-4a77-a4d0-e9ab6cab144d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.183241 Jun 28 12:09:41.455851 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 254/543] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:41 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:41.983028 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9a299c83-81b1-455a-90de-f46c3675866f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:41.983720 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9a299c83-81b1-455a-90de-f46c3675866f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:41.991895 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a299c83-81b1-455a-90de-f46c3675866f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:41.992415 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a299c83-81b1-455a-90de-f46c3675866f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:41.993332 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a299c83-81b1-455a-90de-f46c3675866f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:41.993834 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a299c83-81b1-455a-90de-f46c3675866f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:42.135050 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9a299c83-81b1-455a-90de-f46c3675866f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:42.144681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9a299c83-81b1-455a-90de-f46c3675866f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:42.146199 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9a299c83-81b1-455a-90de-f46c3675866f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:42.147356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9a299c83-81b1-455a-90de-f46c3675866f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1795 microversion: 2.20 time: 0.171199 Jun 28 12:09:42.147901 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 290/544] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:09:41 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1795 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:09:42.477489 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e89bd2d3-9404-4bed-9b3c-de328c4fed46 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:42.478328 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e89bd2d3-9404-4bed-9b3c-de328c4fed46 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:42.489789 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e89bd2d3-9404-4bed-9b3c-de328c4fed46 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:42.490559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e89bd2d3-9404-4bed-9b3c-de328c4fed46 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:42.491846 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e89bd2d3-9404-4bed-9b3c-de328c4fed46 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:42.492573 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e89bd2d3-9404-4bed-9b3c-de328c4fed46 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:42.629149 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e89bd2d3-9404-4bed-9b3c-de328c4fed46 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:42.637230 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e89bd2d3-9404-4bed-9b3c-de328c4fed46 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.166490 Jun 28 12:09:42.637800 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 255/545] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:42 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:43.658463 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-348cae3e-bd09-4970-91d4-e5002aabd3fb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:43.659401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-348cae3e-bd09-4970-91d4-e5002aabd3fb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:43.669990 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-348cae3e-bd09-4970-91d4-e5002aabd3fb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:43.670440 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-348cae3e-bd09-4970-91d4-e5002aabd3fb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:43.671206 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-348cae3e-bd09-4970-91d4-e5002aabd3fb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:43.671641 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-348cae3e-bd09-4970-91d4-e5002aabd3fb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:43.815345 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-348cae3e-bd09-4970-91d4-e5002aabd3fb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:43.823768 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-348cae3e-bd09-4970-91d4-e5002aabd3fb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.172078 Jun 28 12:09:43.824332 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 291/546] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:43 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:44.843002 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b17a6fd7-f3a3-4dbf-af3c-e366d3b342d1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:44.843697 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b17a6fd7-f3a3-4dbf-af3c-e366d3b342d1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:44.850665 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b17a6fd7-f3a3-4dbf-af3c-e366d3b342d1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:44.851115 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b17a6fd7-f3a3-4dbf-af3c-e366d3b342d1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:44.851881 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b17a6fd7-f3a3-4dbf-af3c-e366d3b342d1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:44.852318 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b17a6fd7-f3a3-4dbf-af3c-e366d3b342d1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:44.985276 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b17a6fd7-f3a3-4dbf-af3c-e366d3b342d1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:44.997645 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b17a6fd7-f3a3-4dbf-af3c-e366d3b342d1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.158347 Jun 28 12:09:44.998405 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 256/547] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:44 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:46.017125 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-70199705-7314-4a55-b136-0c3bd1216fbb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:46.018088 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-70199705-7314-4a55-b136-0c3bd1216fbb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:46.024736 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-70199705-7314-4a55-b136-0c3bd1216fbb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:46.025222 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-70199705-7314-4a55-b136-0c3bd1216fbb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:46.025992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-70199705-7314-4a55-b136-0c3bd1216fbb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:46.026471 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-70199705-7314-4a55-b136-0c3bd1216fbb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:46.161167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-70199705-7314-4a55-b136-0c3bd1216fbb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:46.169686 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-70199705-7314-4a55-b136-0c3bd1216fbb tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.156772 Jun 28 12:09:46.170262 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 292/548] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:46 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:47.187233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e20d1f7a-d171-4905-a9f9-7f0e91ff9dee tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:47.187794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e20d1f7a-d171-4905-a9f9-7f0e91ff9dee tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:47.194559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e20d1f7a-d171-4905-a9f9-7f0e91ff9dee tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:47.195011 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e20d1f7a-d171-4905-a9f9-7f0e91ff9dee tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:47.195786 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e20d1f7a-d171-4905-a9f9-7f0e91ff9dee tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:47.196222 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e20d1f7a-d171-4905-a9f9-7f0e91ff9dee tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:47.331736 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e20d1f7a-d171-4905-a9f9-7f0e91ff9dee tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:47.340803 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e20d1f7a-d171-4905-a9f9-7f0e91ff9dee tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.157672 Jun 28 12:09:47.342533 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 257/549] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:47 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:48.365416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0f7d252e-4809-46a3-9477-5effe1ac0096 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:48.366034 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0f7d252e-4809-46a3-9477-5effe1ac0096 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:48.372498 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0f7d252e-4809-46a3-9477-5effe1ac0096 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:48.373348 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0f7d252e-4809-46a3-9477-5effe1ac0096 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:48.374166 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0f7d252e-4809-46a3-9477-5effe1ac0096 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:48.374534 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0f7d252e-4809-46a3-9477-5effe1ac0096 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:48.506565 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0f7d252e-4809-46a3-9477-5effe1ac0096 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:48.515375 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0f7d252e-4809-46a3-9477-5effe1ac0096 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.154132 Jun 28 12:09:48.515917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 293/550] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:48 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:49.534844 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f3499471-db03-4253-b8f3-371d2eba388d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:49.535467 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f3499471-db03-4253-b8f3-371d2eba388d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:49.547300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3499471-db03-4253-b8f3-371d2eba388d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:49.547750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3499471-db03-4253-b8f3-371d2eba388d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:49.548532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3499471-db03-4253-b8f3-371d2eba388d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:49.548995 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3499471-db03-4253-b8f3-371d2eba388d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:49.708594 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f3499471-db03-4253-b8f3-371d2eba388d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:49.720984 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f3499471-db03-4253-b8f3-371d2eba388d tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.190050 Jun 28 12:09:49.721557 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 258/551] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:49 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:50.742743 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-989de00b-8cb9-4b4f-94aa-08ae3345ce07 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:50.746068 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-989de00b-8cb9-4b4f-94aa-08ae3345ce07 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:50.757967 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-989de00b-8cb9-4b4f-94aa-08ae3345ce07 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:50.758501 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-989de00b-8cb9-4b4f-94aa-08ae3345ce07 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:50.759413 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-989de00b-8cb9-4b4f-94aa-08ae3345ce07 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:50.759996 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-989de00b-8cb9-4b4f-94aa-08ae3345ce07 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:50.909988 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-989de00b-8cb9-4b4f-94aa-08ae3345ce07 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:50.921567 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-989de00b-8cb9-4b4f-94aa-08ae3345ce07 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.183043 Jun 28 12:09:50.922145 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 294/552] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:50 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:51.943427 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fb18de10-5069-40da-a692-e8bac6375ec1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:51.944450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fb18de10-5069-40da-a692-e8bac6375ec1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:51.954078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb18de10-5069-40da-a692-e8bac6375ec1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:51.954536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb18de10-5069-40da-a692-e8bac6375ec1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:51.955300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb18de10-5069-40da-a692-e8bac6375ec1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:51.955742 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb18de10-5069-40da-a692-e8bac6375ec1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:52.101194 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fb18de10-5069-40da-a692-e8bac6375ec1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:52.109750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fb18de10-5069-40da-a692-e8bac6375ec1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.172890 Jun 28 12:09:52.110354 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 259/553] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:51 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:53.129838 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-dccfa045-7462-40b7-9be6-05b898f3d348 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:53.130406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-dccfa045-7462-40b7-9be6-05b898f3d348 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:53.137440 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dccfa045-7462-40b7-9be6-05b898f3d348 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:53.137890 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dccfa045-7462-40b7-9be6-05b898f3d348 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:53.138968 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dccfa045-7462-40b7-9be6-05b898f3d348 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:53.139301 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dccfa045-7462-40b7-9be6-05b898f3d348 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:53.295736 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dccfa045-7462-40b7-9be6-05b898f3d348 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:53.304256 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-dccfa045-7462-40b7-9be6-05b898f3d348 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.179589 Jun 28 12:09:53.304783 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 295/554] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:53 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:54.326140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-656c3fed-e56d-436e-a2f8-024e09a7142a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:54.327193 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-656c3fed-e56d-436e-a2f8-024e09a7142a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:54.338890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-656c3fed-e56d-436e-a2f8-024e09a7142a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:54.339641 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-656c3fed-e56d-436e-a2f8-024e09a7142a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:54.340934 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-656c3fed-e56d-436e-a2f8-024e09a7142a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:54.341737 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-656c3fed-e56d-436e-a2f8-024e09a7142a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:54.473883 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-656c3fed-e56d-436e-a2f8-024e09a7142a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:54.486969 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-656c3fed-e56d-436e-a2f8-024e09a7142a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.167291 Jun 28 12:09:54.487800 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 260/555] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:54 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:55.512655 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ca341891-12a9-41d3-9a93-586feb56a138 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:55.513821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ca341891-12a9-41d3-9a93-586feb56a138 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:55.520933 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ca341891-12a9-41d3-9a93-586feb56a138 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:55.521414 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ca341891-12a9-41d3-9a93-586feb56a138 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:55.522177 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ca341891-12a9-41d3-9a93-586feb56a138 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:55.522625 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ca341891-12a9-41d3-9a93-586feb56a138 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:55.660627 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ca341891-12a9-41d3-9a93-586feb56a138 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:55.671777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ca341891-12a9-41d3-9a93-586feb56a138 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.165545 Jun 28 12:09:55.672347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 296/556] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:55 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:55.755343 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-89474322-ad73-4e2e-b973-acb06c103c09 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:09:55.756892 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-89474322-ad73-4e2e-b973-acb06c103c09 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:55.766638 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89474322-ad73-4e2e-b973-acb06c103c09 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:55.767105 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89474322-ad73-4e2e-b973-acb06c103c09 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:55.767869 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89474322-ad73-4e2e-b973-acb06c103c09 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:55.768310 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89474322-ad73-4e2e-b973-acb06c103c09 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:55.844097 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-89474322-ad73-4e2e-b973-acb06c103c09 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "POST /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/action" status: 202 len: 0 microversion: 2.1 time: 0.095273 Jun 28 12:09:55.844739 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 261/557] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:09:55 2022] POST /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:09:55.853792 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-819b53c9-b595-47df-a6b8-287434f76d3a tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:55.854413 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-819b53c9-b595-47df-a6b8-287434f76d3a tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:55.860990 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-819b53c9-b595-47df-a6b8-287434f76d3a tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:55.861500 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-819b53c9-b595-47df-a6b8-287434f76d3a tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:55.862463 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-819b53c9-b595-47df-a6b8-287434f76d3a tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:55.863006 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-819b53c9-b595-47df-a6b8-287434f76d3a tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:56.050315 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-819b53c9-b595-47df-a6b8-287434f76d3a tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:56.058884 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-819b53c9-b595-47df-a6b8-287434f76d3a tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1753 microversion: 2.1 time: 0.209718 Jun 28 12:09:56.069381 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 297/558] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:55 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1753 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:56.691992 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1fa9422e-5005-484d-9b4a-1f7539ca302c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:56.692688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1fa9422e-5005-484d-9b4a-1f7539ca302c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:56.699552 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fa9422e-5005-484d-9b4a-1f7539ca302c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:56.700006 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fa9422e-5005-484d-9b4a-1f7539ca302c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:56.700774 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fa9422e-5005-484d-9b4a-1f7539ca302c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:56.701394 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1fa9422e-5005-484d-9b4a-1f7539ca302c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:56.843643 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1fa9422e-5005-484d-9b4a-1f7539ca302c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:56.851996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1fa9422e-5005-484d-9b4a-1f7539ca302c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.164978 Jun 28 12:09:56.852565 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 262/559] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:56 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:57.080507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8e160ed3-06bd-4ed6-ae69-37cea5232698 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:57.081332 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8e160ed3-06bd-4ed6-ae69-37cea5232698 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:57.084440 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=36 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:09:57.092053 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e160ed3-06bd-4ed6-ae69-37cea5232698 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:57.092558 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e160ed3-06bd-4ed6-ae69-37cea5232698 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:57.093606 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e160ed3-06bd-4ed6-ae69-37cea5232698 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:57.094182 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e160ed3-06bd-4ed6-ae69-37cea5232698 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:57.247919 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8e160ed3-06bd-4ed6-ae69-37cea5232698 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:57.256626 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8e160ed3-06bd-4ed6-ae69-37cea5232698 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1758 microversion: 2.1 time: 0.182087 Jun 28 12:09:57.257238 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 298/560] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:57 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:57.873741 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6ca0ffa8-ab20-4b3e-ae76-fba31ef5de19 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:57.875834 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6ca0ffa8-ab20-4b3e-ae76-fba31ef5de19 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:57.887032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ca0ffa8-ab20-4b3e-ae76-fba31ef5de19 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:57.887779 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ca0ffa8-ab20-4b3e-ae76-fba31ef5de19 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:57.889061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ca0ffa8-ab20-4b3e-ae76-fba31ef5de19 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:57.889582 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ca0ffa8-ab20-4b3e-ae76-fba31ef5de19 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:58.034114 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6ca0ffa8-ab20-4b3e-ae76-fba31ef5de19 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:58.046889 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6ca0ffa8-ab20-4b3e-ae76-fba31ef5de19 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.179482 Jun 28 12:09:58.047726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 263/561] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:57 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:58.277806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ed33fcfd-89b9-4fe2-b38e-e7d20267aa6b tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:58.278782 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ed33fcfd-89b9-4fe2-b38e-e7d20267aa6b tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:58.286359 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed33fcfd-89b9-4fe2-b38e-e7d20267aa6b tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:58.286768 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed33fcfd-89b9-4fe2-b38e-e7d20267aa6b tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:58.287564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed33fcfd-89b9-4fe2-b38e-e7d20267aa6b tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:58.288022 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed33fcfd-89b9-4fe2-b38e-e7d20267aa6b tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:58.437706 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ed33fcfd-89b9-4fe2-b38e-e7d20267aa6b tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:58.446313 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ed33fcfd-89b9-4fe2-b38e-e7d20267aa6b tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1758 microversion: 2.1 time: 0.175094 Jun 28 12:09:58.446995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 299/562] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:58 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:59.070237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5311b88b-fca3-4159-9ece-f318ab0b87e1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:59.070867 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5311b88b-fca3-4159-9ece-f318ab0b87e1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:59.078399 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5311b88b-fca3-4159-9ece-f318ab0b87e1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:59.078824 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5311b88b-fca3-4159-9ece-f318ab0b87e1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:59.079615 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5311b88b-fca3-4159-9ece-f318ab0b87e1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:59.080039 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5311b88b-fca3-4159-9ece-f318ab0b87e1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:59.216181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5311b88b-fca3-4159-9ece-f318ab0b87e1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:59.227303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5311b88b-fca3-4159-9ece-f318ab0b87e1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1736 microversion: 2.1 time: 0.160711 Jun 28 12:09:59.228061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 264/563] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:59 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:09:59.465244 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-48c9d3f0-550e-4cad-bea0-e295145ab046 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:09:59.465916 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-48c9d3f0-550e-4cad-bea0-e295145ab046 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:09:59.473369 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48c9d3f0-550e-4cad-bea0-e295145ab046 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:59.473840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48c9d3f0-550e-4cad-bea0-e295145ab046 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:59.474653 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48c9d3f0-550e-4cad-bea0-e295145ab046 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:09:59.475143 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48c9d3f0-550e-4cad-bea0-e295145ab046 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:09:59.479382 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:09:59.633366 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-48c9d3f0-550e-4cad-bea0-e295145ab046 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:09:59.645828 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-48c9d3f0-550e-4cad-bea0-e295145ab046 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1758 microversion: 2.1 time: 0.184958 Jun 28 12:09:59.646541 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 300/564] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:09:59 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:00.247294 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b7ea0dbe-3cf5-4dfa-bbe5-7ae53891b3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:00.248045 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b7ea0dbe-3cf5-4dfa-bbe5-7ae53891b3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:00.251036 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=37 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:00.256570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7ea0dbe-3cf5-4dfa-bbe5-7ae53891b3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:00.257038 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7ea0dbe-3cf5-4dfa-bbe5-7ae53891b3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:00.257793 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7ea0dbe-3cf5-4dfa-bbe5-7ae53891b3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:00.258218 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7ea0dbe-3cf5-4dfa-bbe5-7ae53891b3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:00.394297 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b7ea0dbe-3cf5-4dfa-bbe5-7ae53891b3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:00.404744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b7ea0dbe-3cf5-4dfa-bbe5-7ae53891b3e9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1716 microversion: 2.1 time: 0.162711 Jun 28 12:10:00.405496 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 265/565] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:00 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:00.468406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ca410829-55db-4630-bb83-e28feed38216 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:00.468971 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ca410829-55db-4630-bb83-e28feed38216 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:00.475734 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ca410829-55db-4630-bb83-e28feed38216 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:00.476193 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ca410829-55db-4630-bb83-e28feed38216 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:00.476978 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ca410829-55db-4630-bb83-e28feed38216 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:00.477418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ca410829-55db-4630-bb83-e28feed38216 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:00.609836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-ca410829-55db-4630-bb83-e28feed38216 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] HTTP exception thrown: Cannot 'detach_volume' instance 820e4864-70b5-4a7e-bd0a-b33670b86066 while it is in vm_state rescued Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ca410829-55db-4630-bb83-e28feed38216 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Request method failure captured: Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments/70f141ee-b47f-413d-9dba-443819e9365f HTTP/1.1 Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5VDlT0QvxPczxGxa6d8wis3CrxqdLDzd7bXGXutpaSUscJ5Gb-1pWgOZu6QxpID_XWgOURaK8-f2td6BRMTAb_uKmkJnYncQO3XENA9Wfl4DGALMI1JwB0ZHgXr5_-PKiSq-JQVwWMC9av7z2Ev1xD0QZ3LvBbAb5bvqKpzdYUVCU Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: c47f35f9ae5e4a55be23a84e3887b915 Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:10:00.611529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:10:00.613207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c47f35f9ae5e4a55be23a84e3887b915"}]}] Jun 28 12:10:00.613207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:10:00.613207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: c47f35f9ae5e4a55be23a84e3887b915 Jun 28 12:10:00.613207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:10:00.613207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-ServerRescueNegativeTestJSON-690784627-project Jun 28 12:10:00.613207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:10:00.613207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:10:00.613207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 2a54e9db924c440da63c04052fe058e6 Jun 28 12:10:00.613207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690784627-project Jun 28 12:10:00.613207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:10:00.613207 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Cannot 'detach_volume' instance 820e4864-70b5-4a7e-bd0a-b33670b86066 while it is in vm_state rescued Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'server_id': '820e4864-70b5-4a7e-bd0a-b33670b86066', 'id': '70f141ee-b47f-413d-9dba-443819e9365f'} Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 820e4864-70b5-4a7e-bd0a-b33670b86066 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:10:00.613986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 820e4864-70b5-4a7e-bd0a-b33670b86066 while it is in vm_state rescued Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 820e4864-70b5-4a7e-bd0a-b33670b86066 while it is in vm_state rescued Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:10:00.615421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ca410829-55db-4630-bb83-e28feed38216 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Returning 409 to user: Cannot 'detach_volume' instance 820e4864-70b5-4a7e-bd0a-b33670b86066 while it is in vm_state rescued {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:10:00.616622 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ca410829-55db-4630-bb83-e28feed38216 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "DELETE /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments/70f141ee-b47f-413d-9dba-443819e9365f" status: 409 len: 152 microversion: 2.1 time: 0.148856 Jun 28 12:10:00.616622 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 301/566] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:10:00 2022] DELETE /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments/70f141ee-b47f-413d-9dba-443819e9365f => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 28 12:10:00.622117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a81686a7-ead7-4706-8354-0b969e322206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:10:00.622653 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a81686a7-ead7-4706-8354-0b969e322206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:00.629006 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a81686a7-ead7-4706-8354-0b969e322206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:00.629466 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a81686a7-ead7-4706-8354-0b969e322206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:00.630237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a81686a7-ead7-4706-8354-0b969e322206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:00.630680 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a81686a7-ead7-4706-8354-0b969e322206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:00.663461 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-39ec6e20-a5f3-4be7-bbe8-032159f62169 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:00.664066 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-39ec6e20-a5f3-4be7-bbe8-032159f62169 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:00.671234 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39ec6e20-a5f3-4be7-bbe8-032159f62169 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:00.671932 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39ec6e20-a5f3-4be7-bbe8-032159f62169 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:00.672709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39ec6e20-a5f3-4be7-bbe8-032159f62169 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:00.673178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39ec6e20-a5f3-4be7-bbe8-032159f62169 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:00.699960 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a81686a7-ead7-4706-8354-0b969e322206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "POST /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/action" status: 202 len: 0 microversion: 2.1 time: 0.081612 Jun 28 12:10:00.700596 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 266/567] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:10:00 2022] POST /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:10:00.709390 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f5c2e0e8-3703-487a-b6ac-cf212a921090 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:00.711451 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f5c2e0e8-3703-487a-b6ac-cf212a921090 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:00.725055 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5c2e0e8-3703-487a-b6ac-cf212a921090 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:00.725509 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5c2e0e8-3703-487a-b6ac-cf212a921090 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:00.726324 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5c2e0e8-3703-487a-b6ac-cf212a921090 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:00.726862 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5c2e0e8-3703-487a-b6ac-cf212a921090 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:00.831198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-39ec6e20-a5f3-4be7-bbe8-032159f62169 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:00.839804 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-39ec6e20-a5f3-4be7-bbe8-032159f62169 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1758 microversion: 2.1 time: 0.180173 Jun 28 12:10:00.844659 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 302/568] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:00 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:00.886440 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f5c2e0e8-3703-487a-b6ac-cf212a921090 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:00.888771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:00.897093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f5c2e0e8-3703-487a-b6ac-cf212a921090 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1724 microversion: 2.1 time: 0.191637 Jun 28 12:10:00.897866 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 267/569] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:00 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:10:01.859517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2d7876e4-e63e-4b99-aacf-aed22acd40fa tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:01.860442 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2d7876e4-e63e-4b99-aacf-aed22acd40fa tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:01.870164 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d7876e4-e63e-4b99-aacf-aed22acd40fa tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:01.870808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d7876e4-e63e-4b99-aacf-aed22acd40fa tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:01.871981 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d7876e4-e63e-4b99-aacf-aed22acd40fa tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:01.872527 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2d7876e4-e63e-4b99-aacf-aed22acd40fa tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:01.915132 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-29bf3c2c-ac65-4d1b-a5a4-5c6ba2e4ae83 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:01.915731 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-29bf3c2c-ac65-4d1b-a5a4-5c6ba2e4ae83 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:01.923977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29bf3c2c-ac65-4d1b-a5a4-5c6ba2e4ae83 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:01.924422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29bf3c2c-ac65-4d1b-a5a4-5c6ba2e4ae83 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:01.925202 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29bf3c2c-ac65-4d1b-a5a4-5c6ba2e4ae83 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:01.925630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29bf3c2c-ac65-4d1b-a5a4-5c6ba2e4ae83 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:02.023539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2d7876e4-e63e-4b99-aacf-aed22acd40fa tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:02.032199 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2d7876e4-e63e-4b99-aacf-aed22acd40fa tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1758 microversion: 2.1 time: 0.178240 Jun 28 12:10:02.032774 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 303/570] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:01 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:02.059503 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-29bf3c2c-ac65-4d1b-a5a4-5c6ba2e4ae83 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:02.068380 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-29bf3c2c-ac65-4d1b-a5a4-5c6ba2e4ae83 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1724 microversion: 2.1 time: 0.157148 Jun 28 12:10:02.069034 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 268/571] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:01 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:03.053693 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6cfb8853-0955-4beb-a75b-13307ad500ed tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:03.054399 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6cfb8853-0955-4beb-a75b-13307ad500ed tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:03.063896 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6cfb8853-0955-4beb-a75b-13307ad500ed tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:03.064850 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6cfb8853-0955-4beb-a75b-13307ad500ed tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:03.066541 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6cfb8853-0955-4beb-a75b-13307ad500ed tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:03.067466 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6cfb8853-0955-4beb-a75b-13307ad500ed tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:03.092404 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a65d6b89-2c42-4f9a-a16d-70f0699db8c1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:03.093577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a65d6b89-2c42-4f9a-a16d-70f0699db8c1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:03.101394 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a65d6b89-2c42-4f9a-a16d-70f0699db8c1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:03.101833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a65d6b89-2c42-4f9a-a16d-70f0699db8c1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:03.102603 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a65d6b89-2c42-4f9a-a16d-70f0699db8c1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:03.103177 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a65d6b89-2c42-4f9a-a16d-70f0699db8c1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:03.223202 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6cfb8853-0955-4beb-a75b-13307ad500ed tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:03.231324 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6cfb8853-0955-4beb-a75b-13307ad500ed tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1758 microversion: 2.1 time: 0.184059 Jun 28 12:10:03.231900 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 304/572] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:03 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:03.235355 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a65d6b89-2c42-4f9a-a16d-70f0699db8c1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:03.243421 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a65d6b89-2c42-4f9a-a16d-70f0699db8c1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1724 microversion: 2.1 time: 0.159243 Jun 28 12:10:03.243959 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 269/573] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:03 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:04.250268 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-baa90670-b81a-4ca2-83eb-91d71020ad25 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:04.250886 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-baa90670-b81a-4ca2-83eb-91d71020ad25 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:04.257931 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baa90670-b81a-4ca2-83eb-91d71020ad25 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:04.258384 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baa90670-b81a-4ca2-83eb-91d71020ad25 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:04.259152 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baa90670-b81a-4ca2-83eb-91d71020ad25 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:04.259584 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baa90670-b81a-4ca2-83eb-91d71020ad25 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:04.260541 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0b7ff603-7c65-4185-a830-518aa0297078 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:04.261342 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0b7ff603-7c65-4185-a830-518aa0297078 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:04.268272 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b7ff603-7c65-4185-a830-518aa0297078 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:04.268725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b7ff603-7c65-4185-a830-518aa0297078 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:04.269530 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b7ff603-7c65-4185-a830-518aa0297078 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:04.269969 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b7ff603-7c65-4185-a830-518aa0297078 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:04.399272 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0b7ff603-7c65-4185-a830-518aa0297078 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:04.407305 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0b7ff603-7c65-4185-a830-518aa0297078 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1724 microversion: 2.1 time: 0.150567 Jun 28 12:10:04.407911 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 270/574] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:04 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:04.409683 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-baa90670-b81a-4ca2-83eb-91d71020ad25 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:04.417798 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-baa90670-b81a-4ca2-83eb-91d71020ad25 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1758 microversion: 2.1 time: 0.172472 Jun 28 12:10:04.418352 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 305/575] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:04 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:05.428256 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-96837013-54ba-4a93-81e3-e8d744a68ed2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:05.431536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-96837013-54ba-4a93-81e3-e8d744a68ed2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:05.439432 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-96837013-54ba-4a93-81e3-e8d744a68ed2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:05.440187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-96837013-54ba-4a93-81e3-e8d744a68ed2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:05.440468 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8bac497b-97d6-4e6b-9dc9-e118bf24309d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:05.441204 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8bac497b-97d6-4e6b-9dc9-e118bf24309d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:05.441502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-96837013-54ba-4a93-81e3-e8d744a68ed2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:05.442230 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-96837013-54ba-4a93-81e3-e8d744a68ed2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:05.452129 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bac497b-97d6-4e6b-9dc9-e118bf24309d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:05.453048 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bac497b-97d6-4e6b-9dc9-e118bf24309d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:05.454450 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bac497b-97d6-4e6b-9dc9-e118bf24309d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:05.454897 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bac497b-97d6-4e6b-9dc9-e118bf24309d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:05.585801 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-96837013-54ba-4a93-81e3-e8d744a68ed2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:05.595089 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-96837013-54ba-4a93-81e3-e8d744a68ed2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1730 microversion: 2.1 time: 0.173866 Jun 28 12:10:05.595661 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 271/576] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:05 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:05.599679 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8bac497b-97d6-4e6b-9dc9-e118bf24309d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:05.608111 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8bac497b-97d6-4e6b-9dc9-e118bf24309d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1758 microversion: 2.1 time: 0.175169 Jun 28 12:10:05.608677 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 306/577] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:05 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:05.611600 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-222f8c94-bdb0-4a89-9fc4-298e66af4d3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:05.612100 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-222f8c94-bdb0-4a89-9fc4-298e66af4d3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:05.618368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-222f8c94-bdb0-4a89-9fc4-298e66af4d3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:05.618823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-222f8c94-bdb0-4a89-9fc4-298e66af4d3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:05.619593 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-222f8c94-bdb0-4a89-9fc4-298e66af4d3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:05.620028 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-222f8c94-bdb0-4a89-9fc4-298e66af4d3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:05.697939 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-222f8c94-bdb0-4a89-9fc4-298e66af4d3c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090061 Jun 28 12:10:05.698623 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 272/578] 10.222.0.55 () {58 vars in 1274 bytes} [Tue Jun 28 12:10:05 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:10:05.729725 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4e2a5085-beac-42fd-9d25-9badc5859711 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:05.730222 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4e2a5085-beac-42fd-9d25-9badc5859711 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:05.736451 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e2a5085-beac-42fd-9d25-9badc5859711 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:05.736896 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e2a5085-beac-42fd-9d25-9badc5859711 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:05.737680 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e2a5085-beac-42fd-9d25-9badc5859711 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:05.738112 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4e2a5085-beac-42fd-9d25-9badc5859711 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:05.821054 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-4e2a5085-beac-42fd-9d25-9badc5859711 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lazy-loading 'services' on Instance uuid ed81e0c7-a44e-497b-bf2e-cf208dd340de {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:10:05.940378 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4e2a5085-beac-42fd-9d25-9badc5859711 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/os-volume_attachments/f24835a0-2f78-4d44-8ed5-9f9dd87aec97" status: 202 len: 0 microversion: 2.1 time: 0.320846 Jun 28 12:10:05.941172 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 307/579] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:10:05 2022] DELETE /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/os-volume_attachments/f24835a0-2f78-4d44-8ed5-9f9dd87aec97 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:10:06.629489 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ad5cbce8-85dd-4942-a6e9-af29553562e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:06.631593 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ad5cbce8-85dd-4942-a6e9-af29553562e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:06.641183 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad5cbce8-85dd-4942-a6e9-af29553562e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:06.641641 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad5cbce8-85dd-4942-a6e9-af29553562e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:06.642431 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad5cbce8-85dd-4942-a6e9-af29553562e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:06.642866 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ad5cbce8-85dd-4942-a6e9-af29553562e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:06.696998 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-ab75857e-f4ad-4e67-b2a6-48600b5f5f73 req-a6c3ce04-f101-4b14-8baf-06382880ee4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820e4864-70b5-4a7e-bd0a-b33670b86066", "tag": "c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:10:06.706389 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ab75857e-f4ad-4e67-b2a6-48600b5f5f73 req-a6c3ce04-f101-4b14-8baf-06382880ee4b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:06.707492 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ab75857e-f4ad-4e67-b2a6-48600b5f5f73 req-a6c3ce04-f101-4b14-8baf-06382880ee4b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:06.720378 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-ab75857e-f4ad-4e67-b2a6-48600b5f5f73 req-a6c3ce04-f101-4b14-8baf-06382880ee4b service nova] Creating event network-changed:c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e for instance 820e4864-70b5-4a7e-bd0a-b33670b86066 on hv-cinder-84795 Jun 28 12:10:06.725214 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-ab75857e-f4ad-4e67-b2a6-48600b5f5f73 req-a6c3ce04-f101-4b14-8baf-06382880ee4b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105766 Jun 28 12:10:06.726167 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 273/580] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:10:06.833898 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ad5cbce8-85dd-4942-a6e9-af29553562e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:06.848567 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ad5cbce8-85dd-4942-a6e9-af29553562e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1758 microversion: 2.1 time: 0.226413 Jun 28 12:10:06.849436 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 308/581] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:06 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1758 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:07.064197 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ffd86846-9ae7-406d-81f9-8814b3b928e4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:10:07.071270 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffd86846-9ae7-406d-81f9-8814b3b928e4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:07.072440 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffd86846-9ae7-406d-81f9-8814b3b928e4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:07.100719 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ffd86846-9ae7-406d-81f9-8814b3b928e4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Going to try to stop instance {{(pid=117889) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 28 12:10:07.150879 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ffd86846-9ae7-406d-81f9-8814b3b928e4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "POST /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/action" status: 202 len: 0 microversion: 2.1 time: 0.091631 Jun 28 12:10:07.152035 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 274/582] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:10:07 2022] POST /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:10:07.161233 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-005ad7b3-48f8-4258-a6df-475af6d5ac1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:07.161844 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-005ad7b3-48f8-4258-a6df-475af6d5ac1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:07.170905 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-005ad7b3-48f8-4258-a6df-475af6d5ac1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:07.171799 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-005ad7b3-48f8-4258-a6df-475af6d5ac1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:07.173299 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-005ad7b3-48f8-4258-a6df-475af6d5ac1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:07.174052 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-005ad7b3-48f8-4258-a6df-475af6d5ac1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:07.387241 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-005ad7b3-48f8-4258-a6df-475af6d5ac1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:07.400180 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-005ad7b3-48f8-4258-a6df-475af6d5ac1b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.243701 Jun 28 12:10:07.401032 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 309/583] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:07 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:10:07.872593 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0a8cd479-aa2c-4f6f-a505-25348e037949 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:07.873740 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0a8cd479-aa2c-4f6f-a505-25348e037949 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:07.881088 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a8cd479-aa2c-4f6f-a505-25348e037949 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:07.881546 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a8cd479-aa2c-4f6f-a505-25348e037949 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:07.882314 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a8cd479-aa2c-4f6f-a505-25348e037949 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:07.882753 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a8cd479-aa2c-4f6f-a505-25348e037949 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:08.031506 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0a8cd479-aa2c-4f6f-a505-25348e037949 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:08.039732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0a8cd479-aa2c-4f6f-a505-25348e037949 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1758 microversion: 2.1 time: 0.175239 Jun 28 12:10:08.040291 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 275/584] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:07 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:08.421622 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9518dfa9-42cc-42d5-9d5d-8f2857b0f2aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:08.422813 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9518dfa9-42cc-42d5-9d5d-8f2857b0f2aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:08.430065 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9518dfa9-42cc-42d5-9d5d-8f2857b0f2aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:08.430563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9518dfa9-42cc-42d5-9d5d-8f2857b0f2aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:08.431414 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9518dfa9-42cc-42d5-9d5d-8f2857b0f2aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:08.431889 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9518dfa9-42cc-42d5-9d5d-8f2857b0f2aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:08.573064 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9518dfa9-42cc-42d5-9d5d-8f2857b0f2aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:08.581016 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9518dfa9-42cc-42d5-9d5d-8f2857b0f2aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.166243 Jun 28 12:10:08.581548 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 310/585] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:08 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:08.740617 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-61738530-ffc3-42a9-bc6e-2cb7fafa94c5 req-f34869b6-8682-4766-b70f-deb3e5c239b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820e4864-70b5-4a7e-bd0a-b33670b86066", "tag": "c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:10:08.750275 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-61738530-ffc3-42a9-bc6e-2cb7fafa94c5 req-f34869b6-8682-4766-b70f-deb3e5c239b1 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:08.750691 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-61738530-ffc3-42a9-bc6e-2cb7fafa94c5 req-f34869b6-8682-4766-b70f-deb3e5c239b1 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:08.767098 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-61738530-ffc3-42a9-bc6e-2cb7fafa94c5 req-f34869b6-8682-4766-b70f-deb3e5c239b1 service nova] Creating event network-changed:c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e for instance 820e4864-70b5-4a7e-bd0a-b33670b86066 on hv-cinder-84795 Jun 28 12:10:08.772215 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-61738530-ffc3-42a9-bc6e-2cb7fafa94c5 req-f34869b6-8682-4766-b70f-deb3e5c239b1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035694 Jun 28 12:10:08.773009 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 276/586] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:10:09.068056 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-51d12dbd-b7de-4e7a-b638-68b8c3626f6d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:09.069545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-51d12dbd-b7de-4e7a-b638-68b8c3626f6d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:09.080748 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-51d12dbd-b7de-4e7a-b638-68b8c3626f6d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:09.081221 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-51d12dbd-b7de-4e7a-b638-68b8c3626f6d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:09.081998 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-51d12dbd-b7de-4e7a-b638-68b8c3626f6d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:09.083551 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-51d12dbd-b7de-4e7a-b638-68b8c3626f6d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:09.274824 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-51d12dbd-b7de-4e7a-b638-68b8c3626f6d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:09.284759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-51d12dbd-b7de-4e7a-b638-68b8c3626f6d tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1758 microversion: 2.1 time: 0.224577 Jun 28 12:10:09.285361 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 311/587] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:09 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1758 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:09.601995 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cbcbcb21-9c64-4740-bbda-b49a36191395 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:09.602787 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cbcbcb21-9c64-4740-bbda-b49a36191395 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:09.610054 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbcbcb21-9c64-4740-bbda-b49a36191395 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:09.611195 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbcbcb21-9c64-4740-bbda-b49a36191395 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:09.611965 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbcbcb21-9c64-4740-bbda-b49a36191395 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:09.612399 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbcbcb21-9c64-4740-bbda-b49a36191395 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:09.759533 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cbcbcb21-9c64-4740-bbda-b49a36191395 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:09.769403 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cbcbcb21-9c64-4740-bbda-b49a36191395 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.172827 Jun 28 12:10:09.778922 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 277/588] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:09 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:10.306493 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-29286d2e-6c24-43c9-9ab3-fa512382477e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:10.307235 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-29286d2e-6c24-43c9-9ab3-fa512382477e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:10.316753 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-29286d2e-6c24-43c9-9ab3-fa512382477e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:10.317421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-29286d2e-6c24-43c9-9ab3-fa512382477e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:10.318366 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-29286d2e-6c24-43c9-9ab3-fa512382477e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:10.318901 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-29286d2e-6c24-43c9-9ab3-fa512382477e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:10.462572 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-29286d2e-6c24-43c9-9ab3-fa512382477e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:10.470978 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-29286d2e-6c24-43c9-9ab3-fa512382477e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1761 microversion: 2.1 time: 0.170571 Jun 28 12:10:10.471535 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 312/589] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:10 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1761 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:10.788313 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3a746244-98d4-4b03-ab71-18c5c3331ba4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:10.789043 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3a746244-98d4-4b03-ab71-18c5c3331ba4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:10.796445 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a746244-98d4-4b03-ab71-18c5c3331ba4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:10.796895 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a746244-98d4-4b03-ab71-18c5c3331ba4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:10.797763 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a746244-98d4-4b03-ab71-18c5c3331ba4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:10.798230 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a746244-98d4-4b03-ab71-18c5c3331ba4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:10.927303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3a746244-98d4-4b03-ab71-18c5c3331ba4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:10.935205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3a746244-98d4-4b03-ab71-18c5c3331ba4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.151461 Jun 28 12:10:10.935771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 278/590] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:10 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:11.955831 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9e644529-f4b7-4126-93c8-95c779d259da tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:11.956536 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9e644529-f4b7-4126-93c8-95c779d259da tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:11.965172 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9e644529-f4b7-4126-93c8-95c779d259da tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:11.965705 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9e644529-f4b7-4126-93c8-95c779d259da tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:11.966600 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9e644529-f4b7-4126-93c8-95c779d259da tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:11.967116 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9e644529-f4b7-4126-93c8-95c779d259da tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:12.118114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9e644529-f4b7-4126-93c8-95c779d259da tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:12.126223 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9e644529-f4b7-4126-93c8-95c779d259da tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.175750 Jun 28 12:10:12.126819 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 313/591] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:11 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:13.143485 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6e75c093-952b-421b-9e60-fe9ee15bf8f9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:13.144131 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6e75c093-952b-421b-9e60-fe9ee15bf8f9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:13.153905 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e75c093-952b-421b-9e60-fe9ee15bf8f9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:13.154543 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e75c093-952b-421b-9e60-fe9ee15bf8f9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:13.155664 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e75c093-952b-421b-9e60-fe9ee15bf8f9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:13.156208 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6e75c093-952b-421b-9e60-fe9ee15bf8f9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:13.299856 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6e75c093-952b-421b-9e60-fe9ee15bf8f9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:13.308042 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6e75c093-952b-421b-9e60-fe9ee15bf8f9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.168995 Jun 28 12:10:13.308789 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 279/592] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:13 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:14.329330 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2cbe4e60-f4d3-46ce-bdf1-5aa66466b475 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:14.330028 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2cbe4e60-f4d3-46ce-bdf1-5aa66466b475 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:14.337463 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2cbe4e60-f4d3-46ce-bdf1-5aa66466b475 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:14.337906 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2cbe4e60-f4d3-46ce-bdf1-5aa66466b475 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:14.338660 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2cbe4e60-f4d3-46ce-bdf1-5aa66466b475 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:14.339089 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2cbe4e60-f4d3-46ce-bdf1-5aa66466b475 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:14.482236 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2cbe4e60-f4d3-46ce-bdf1-5aa66466b475 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:14.493569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2cbe4e60-f4d3-46ce-bdf1-5aa66466b475 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.170240 Jun 28 12:10:14.494324 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 314/593] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:14 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:15.517586 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-aee68cfe-3ee0-4ab8-adce-7bf5310acddf tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:15.518616 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-aee68cfe-3ee0-4ab8-adce-7bf5310acddf tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:15.529778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aee68cfe-3ee0-4ab8-adce-7bf5310acddf tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:15.530556 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aee68cfe-3ee0-4ab8-adce-7bf5310acddf tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:15.531800 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aee68cfe-3ee0-4ab8-adce-7bf5310acddf tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:15.532528 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aee68cfe-3ee0-4ab8-adce-7bf5310acddf tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:15.673120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-aee68cfe-3ee0-4ab8-adce-7bf5310acddf tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:15.681072 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-aee68cfe-3ee0-4ab8-adce-7bf5310acddf tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.170013 Jun 28 12:10:15.681636 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 280/594] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:15 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:16.705708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-be9f5e45-bf71-40de-884a-210a351b201f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:16.706310 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-be9f5e45-bf71-40de-884a-210a351b201f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:16.713716 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be9f5e45-bf71-40de-884a-210a351b201f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:16.714169 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be9f5e45-bf71-40de-884a-210a351b201f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:16.714935 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be9f5e45-bf71-40de-884a-210a351b201f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:16.715375 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-be9f5e45-bf71-40de-884a-210a351b201f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:16.855873 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-be9f5e45-bf71-40de-884a-210a351b201f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:16.863581 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-be9f5e45-bf71-40de-884a-210a351b201f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.163626 Jun 28 12:10:16.864151 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 315/595] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:16 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:17.883533 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ee270719-fce4-44e4-b1ce-1eb027bdd8c4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:17.884326 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ee270719-fce4-44e4-b1ce-1eb027bdd8c4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:17.892933 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee270719-fce4-44e4-b1ce-1eb027bdd8c4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:17.893429 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee270719-fce4-44e4-b1ce-1eb027bdd8c4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:17.894199 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee270719-fce4-44e4-b1ce-1eb027bdd8c4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:17.894645 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee270719-fce4-44e4-b1ce-1eb027bdd8c4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:18.036647 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ee270719-fce4-44e4-b1ce-1eb027bdd8c4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:18.047860 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ee270719-fce4-44e4-b1ce-1eb027bdd8c4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.170445 Jun 28 12:10:18.048658 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 281/596] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:17 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:19.068925 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-08300b4c-4f13-47d8-9955-16ffc70e14cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:19.069926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-08300b4c-4f13-47d8-9955-16ffc70e14cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:19.078049 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08300b4c-4f13-47d8-9955-16ffc70e14cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:19.078491 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08300b4c-4f13-47d8-9955-16ffc70e14cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:19.079339 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08300b4c-4f13-47d8-9955-16ffc70e14cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:19.079746 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-08300b4c-4f13-47d8-9955-16ffc70e14cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:19.084402 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:19.223929 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-08300b4c-4f13-47d8-9955-16ffc70e14cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:19.231545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-08300b4c-4f13-47d8-9955-16ffc70e14cb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.169125 Jun 28 12:10:19.232323 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 316/597] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:19 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:20.254459 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eee73355-0f3a-474d-b13e-c0fde9af23ce tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:20.255334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eee73355-0f3a-474d-b13e-c0fde9af23ce tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:20.266409 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eee73355-0f3a-474d-b13e-c0fde9af23ce tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:20.267169 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eee73355-0f3a-474d-b13e-c0fde9af23ce tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:20.268586 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eee73355-0f3a-474d-b13e-c0fde9af23ce tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:20.269061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eee73355-0f3a-474d-b13e-c0fde9af23ce tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:20.404868 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eee73355-0f3a-474d-b13e-c0fde9af23ce tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:20.413829 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eee73355-0f3a-474d-b13e-c0fde9af23ce tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.166788 Jun 28 12:10:20.414438 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 282/598] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:20 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:21.435446 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ac3e3fb0-4bea-4e7c-b714-a221bde9f719 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:21.436457 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ac3e3fb0-4bea-4e7c-b714-a221bde9f719 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:21.445253 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac3e3fb0-4bea-4e7c-b714-a221bde9f719 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:21.445703 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac3e3fb0-4bea-4e7c-b714-a221bde9f719 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:21.446466 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac3e3fb0-4bea-4e7c-b714-a221bde9f719 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:21.446905 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ac3e3fb0-4bea-4e7c-b714-a221bde9f719 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:21.595058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ac3e3fb0-4bea-4e7c-b714-a221bde9f719 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:21.606948 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ac3e3fb0-4bea-4e7c-b714-a221bde9f719 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.177838 Jun 28 12:10:21.607731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 317/599] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:21 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:22.630366 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-75f2a187-ec12-4f9c-9db6-aa2c46af6df3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:22.631381 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-75f2a187-ec12-4f9c-9db6-aa2c46af6df3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:22.642985 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-75f2a187-ec12-4f9c-9db6-aa2c46af6df3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:22.643550 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-75f2a187-ec12-4f9c-9db6-aa2c46af6df3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:22.644196 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-75f2a187-ec12-4f9c-9db6-aa2c46af6df3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:22.644635 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-75f2a187-ec12-4f9c-9db6-aa2c46af6df3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:22.776580 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-75f2a187-ec12-4f9c-9db6-aa2c46af6df3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:22.784665 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-75f2a187-ec12-4f9c-9db6-aa2c46af6df3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.161083 Jun 28 12:10:22.785291 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 283/600] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:22 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:23.806787 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-233768f6-2c14-44dd-af42-3580ee38c472 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:23.807426 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-233768f6-2c14-44dd-af42-3580ee38c472 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:23.814856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-233768f6-2c14-44dd-af42-3580ee38c472 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:23.815379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-233768f6-2c14-44dd-af42-3580ee38c472 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:23.816136 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-233768f6-2c14-44dd-af42-3580ee38c472 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:23.816564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-233768f6-2c14-44dd-af42-3580ee38c472 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:23.968540 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-233768f6-2c14-44dd-af42-3580ee38c472 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:23.976655 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-233768f6-2c14-44dd-af42-3580ee38c472 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.173777 Jun 28 12:10:23.977301 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 318/601] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:23 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:24.996445 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-60274b2a-0773-43da-b5c7-fdd35401e131 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:24.997223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-60274b2a-0773-43da-b5c7-fdd35401e131 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:25.005100 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-60274b2a-0773-43da-b5c7-fdd35401e131 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:25.005551 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-60274b2a-0773-43da-b5c7-fdd35401e131 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:25.007097 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-60274b2a-0773-43da-b5c7-fdd35401e131 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:25.007596 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-60274b2a-0773-43da-b5c7-fdd35401e131 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:25.152686 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-60274b2a-0773-43da-b5c7-fdd35401e131 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:25.160823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-60274b2a-0773-43da-b5c7-fdd35401e131 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.168609 Jun 28 12:10:25.161425 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 284/602] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:24 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:26.182831 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-755a3673-fd34-47a7-92f7-4fe907d0afca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:26.183694 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-755a3673-fd34-47a7-92f7-4fe907d0afca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:26.195165 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-755a3673-fd34-47a7-92f7-4fe907d0afca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:26.195896 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-755a3673-fd34-47a7-92f7-4fe907d0afca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:26.197198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-755a3673-fd34-47a7-92f7-4fe907d0afca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:26.197898 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-755a3673-fd34-47a7-92f7-4fe907d0afca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:26.355227 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-755a3673-fd34-47a7-92f7-4fe907d0afca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:26.363205 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-755a3673-fd34-47a7-92f7-4fe907d0afca tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.186948 Jun 28 12:10:26.363782 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 319/603] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:26 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:10:27.383900 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a7d6ce2d-bde6-4e01-8150-33288bf38fa9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:27.384855 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a7d6ce2d-bde6-4e01-8150-33288bf38fa9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:27.396063 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7d6ce2d-bde6-4e01-8150-33288bf38fa9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:27.397395 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7d6ce2d-bde6-4e01-8150-33288bf38fa9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:27.398650 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7d6ce2d-bde6-4e01-8150-33288bf38fa9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:27.399355 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a7d6ce2d-bde6-4e01-8150-33288bf38fa9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:27.403719 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:27.540178 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a7d6ce2d-bde6-4e01-8150-33288bf38fa9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:27.548594 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a7d6ce2d-bde6-4e01-8150-33288bf38fa9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1677 microversion: 2.1 time: 0.171470 Jun 28 12:10:27.549589 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 285/604] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:27 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:28.566428 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e7cbcc8b-602a-474a-a56d-ef33771e3e63 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:28.567579 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e7cbcc8b-602a-474a-a56d-ef33771e3e63 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:28.569983 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=44 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:28.575689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc8b-602a-474a-a56d-ef33771e3e63 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:28.576169 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc8b-602a-474a-a56d-ef33771e3e63 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:28.576921 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc8b-602a-474a-a56d-ef33771e3e63 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:28.577352 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7cbcc8b-602a-474a-a56d-ef33771e3e63 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:28.721899 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e7cbcc8b-602a-474a-a56d-ef33771e3e63 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:28.729843 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e7cbcc8b-602a-474a-a56d-ef33771e3e63 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1654 microversion: 2.1 time: 0.167328 Jun 28 12:10:28.730418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 320/605] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:28 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1654 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:28.749780 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-87d88b80-146c-4cba-98a7-1dbf6e85af57 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:10:28.758656 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87d88b80-146c-4cba-98a7-1dbf6e85af57 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:28.759112 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87d88b80-146c-4cba-98a7-1dbf6e85af57 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:28.782007 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-87d88b80-146c-4cba-98a7-1dbf6e85af57 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Going to try to start instance {{(pid=117889) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 28 12:10:28.828754 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-87d88b80-146c-4cba-98a7-1dbf6e85af57 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "POST /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/action" status: 202 len: 0 microversion: 2.1 time: 0.085831 Jun 28 12:10:28.829300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 286/606] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:10:28 2022] POST /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 12:10:28.838160 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0f47f2f6-5843-44af-acbb-7c614e293701 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:28.838777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0f47f2f6-5843-44af-acbb-7c614e293701 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:28.844930 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0f47f2f6-5843-44af-acbb-7c614e293701 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:28.845374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0f47f2f6-5843-44af-acbb-7c614e293701 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:28.846180 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0f47f2f6-5843-44af-acbb-7c614e293701 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:28.846654 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0f47f2f6-5843-44af-acbb-7c614e293701 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:28.990163 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0f47f2f6-5843-44af-acbb-7c614e293701 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:28.997823 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0f47f2f6-5843-44af-acbb-7c614e293701 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1663 microversion: 2.1 time: 0.163896 Jun 28 12:10:28.998359 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 321/607] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:28 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:30.015626 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-59bd6d5a-e9d0-4db5-9798-53fb325381aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:30.016439 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-59bd6d5a-e9d0-4db5-9798-53fb325381aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:30.024306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59bd6d5a-e9d0-4db5-9798-53fb325381aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:30.024754 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59bd6d5a-e9d0-4db5-9798-53fb325381aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:30.025552 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59bd6d5a-e9d0-4db5-9798-53fb325381aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:30.025983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-59bd6d5a-e9d0-4db5-9798-53fb325381aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:30.163234 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-59bd6d5a-e9d0-4db5-9798-53fb325381aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:30.171185 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-59bd6d5a-e9d0-4db5-9798-53fb325381aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1663 microversion: 2.1 time: 0.159857 Jun 28 12:10:30.171755 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 287/608] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:30 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:31.193476 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d10bee12-e1b2-4183-a5dc-5c668c46a623 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:31.194032 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d10bee12-e1b2-4183-a5dc-5c668c46a623 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:31.202351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d10bee12-e1b2-4183-a5dc-5c668c46a623 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:31.202800 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d10bee12-e1b2-4183-a5dc-5c668c46a623 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:31.203565 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d10bee12-e1b2-4183-a5dc-5c668c46a623 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:31.203988 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d10bee12-e1b2-4183-a5dc-5c668c46a623 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:31.368756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d10bee12-e1b2-4183-a5dc-5c668c46a623 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:31.376975 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d10bee12-e1b2-4183-a5dc-5c668c46a623 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1667 microversion: 2.1 time: 0.190192 Jun 28 12:10:31.377521 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 322/609] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:31 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1667 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:48.929931 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb135116-5b66-4b32-8db0-47488f551d44 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:48.930787 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cb135116-5b66-4b32-8db0-47488f551d44 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:48.933272 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=45 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:48.933919 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:48.940894 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb135116-5b66-4b32-8db0-47488f551d44 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:48.941425 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb135116-5b66-4b32-8db0-47488f551d44 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:48.942226 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb135116-5b66-4b32-8db0-47488f551d44 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:48.942663 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb135116-5b66-4b32-8db0-47488f551d44 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:48.975500 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cb135116-5b66-4b32-8db0-47488f551d44 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments/970c6284-82d0-46db-89ca-470534ad6ec2" status: 200 len: 194 microversion: 2.20 time: 0.052648 Jun 28 12:10:48.976076 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 288/610] 10.222.0.55 () {60 vars in 1453 bytes} [Tue Jun 28 12:10:48 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments/970c6284-82d0-46db-89ca-470534ad6ec2 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 12:10:49.050456 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b82de9fe-a7f5-47ab-8adb-8d9e100e8aef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:49.051257 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b82de9fe-a7f5-47ab-8adb-8d9e100e8aef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:49.054574 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=5 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:49.055370 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=40 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:49.061636 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b82de9fe-a7f5-47ab-8adb-8d9e100e8aef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:49.062085 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b82de9fe-a7f5-47ab-8adb-8d9e100e8aef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:49.062864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b82de9fe-a7f5-47ab-8adb-8d9e100e8aef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:49.063297 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b82de9fe-a7f5-47ab-8adb-8d9e100e8aef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:49.148995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-b82de9fe-a7f5-47ab-8adb-8d9e100e8aef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lazy-loading 'services' on Instance uuid 350964d7-7d2a-4335-b45e-c50e8cd87f7d {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:10:49.229847 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b82de9fe-a7f5-47ab-8adb-8d9e100e8aef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "DELETE /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments/970c6284-82d0-46db-89ca-470534ad6ec2" status: 202 len: 0 microversion: 2.20 time: 0.185351 Jun 28 12:10:49.230603 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 323/611] 10.222.0.55 () {60 vars in 1456 bytes} [Tue Jun 28 12:10:49 2022] DELETE /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments/970c6284-82d0-46db-89ca-470534ad6ec2 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:10:49.243469 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d82835df-04ea-408b-9900-2029a2d8f720 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:49.244721 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d82835df-04ea-408b-9900-2029a2d8f720 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:49.251126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d82835df-04ea-408b-9900-2029a2d8f720 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:49.252056 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d82835df-04ea-408b-9900-2029a2d8f720 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:49.252333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d82835df-04ea-408b-9900-2029a2d8f720 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:49.252763 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d82835df-04ea-408b-9900-2029a2d8f720 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:49.282211 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d82835df-04ea-408b-9900-2029a2d8f720 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043281 Jun 28 12:10:49.282775 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 324/612] 10.222.0.55 () {60 vars in 1342 bytes} [Tue Jun 28 12:10:49 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 12:10:49.301773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c7fb5041-d56b-40d4-96ce-8ba1256b28c7 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:49.302234 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c7fb5041-d56b-40d4-96ce-8ba1256b28c7 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:49.308569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7fb5041-d56b-40d4-96ce-8ba1256b28c7 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:49.309063 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7fb5041-d56b-40d4-96ce-8ba1256b28c7 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:49.309825 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7fb5041-d56b-40d4-96ce-8ba1256b28c7 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:49.310262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7fb5041-d56b-40d4-96ce-8ba1256b28c7 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:49.334938 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c7fb5041-d56b-40d4-96ce-8ba1256b28c7 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:10:49.422061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c7fb5041-d56b-40d4-96ce-8ba1256b28c7 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 204 len: 0 microversion: 2.1 time: 0.232276 Jun 28 12:10:49.422686 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 289/613] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:10:49 2022] DELETE /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 12:10:49.432572 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-062cfdb7-5a0a-49e8-b07c-a79164b62234 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:49.433265 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-062cfdb7-5a0a-49e8-b07c-a79164b62234 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:49.441710 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-062cfdb7-5a0a-49e8-b07c-a79164b62234 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:49.442184 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-062cfdb7-5a0a-49e8-b07c-a79164b62234 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:49.443244 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-062cfdb7-5a0a-49e8-b07c-a79164b62234 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:49.443837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-062cfdb7-5a0a-49e8-b07c-a79164b62234 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:49.590049 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-062cfdb7-5a0a-49e8-b07c-a79164b62234 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:49.598366 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-062cfdb7-5a0a-49e8-b07c-a79164b62234 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1579 microversion: 2.1 time: 0.171127 Jun 28 12:10:49.598998 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 325/614] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:49 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1579 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:50.300108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-56f5cf33-836a-4bb1-9878-82c00495972c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:50.301894 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-56f5cf33-836a-4bb1-9878-82c00495972c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:50.313120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56f5cf33-836a-4bb1-9878-82c00495972c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:50.313564 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56f5cf33-836a-4bb1-9878-82c00495972c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:50.314629 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56f5cf33-836a-4bb1-9878-82c00495972c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:50.315217 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56f5cf33-836a-4bb1-9878-82c00495972c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:50.352558 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-56f5cf33-836a-4bb1-9878-82c00495972c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059752 Jun 28 12:10:50.353149 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 290/615] 10.222.0.55 () {60 vars in 1342 bytes} [Tue Jun 28 12:10:50 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 12:10:50.620342 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-17adb086-9886-4a7e-ac51-0eb729120f36 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:50.620956 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-17adb086-9886-4a7e-ac51-0eb729120f36 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:50.628151 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-17adb086-9886-4a7e-ac51-0eb729120f36 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:50.628607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-17adb086-9886-4a7e-ac51-0eb729120f36 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:50.629415 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-17adb086-9886-4a7e-ac51-0eb729120f36 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:50.629844 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-17adb086-9886-4a7e-ac51-0eb729120f36 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:50.782076 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-17adb086-9886-4a7e-ac51-0eb729120f36 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:50.791927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-17adb086-9886-4a7e-ac51-0eb729120f36 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1579 microversion: 2.1 time: 0.176600 Jun 28 12:10:50.792516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 326/616] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:50 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:51.368255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fe44be07-7284-4486-b8ec-2c712018252c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:51.370618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fe44be07-7284-4486-b8ec-2c712018252c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:51.377766 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fe44be07-7284-4486-b8ec-2c712018252c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:51.378214 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fe44be07-7284-4486-b8ec-2c712018252c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:51.379108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fe44be07-7284-4486-b8ec-2c712018252c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:51.379532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fe44be07-7284-4486-b8ec-2c712018252c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:51.419902 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fe44be07-7284-4486-b8ec-2c712018252c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057909 Jun 28 12:10:51.420584 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 291/617] 10.222.0.55 () {60 vars in 1342 bytes} [Tue Jun 28 12:10:51 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 12:10:51.818277 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bbd2c79b-f199-4abe-a5ec-7f8e38eed989 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:51.818921 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bbd2c79b-f199-4abe-a5ec-7f8e38eed989 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:51.826085 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbd2c79b-f199-4abe-a5ec-7f8e38eed989 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:51.826517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbd2c79b-f199-4abe-a5ec-7f8e38eed989 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:51.827302 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbd2c79b-f199-4abe-a5ec-7f8e38eed989 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:51.827764 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbd2c79b-f199-4abe-a5ec-7f8e38eed989 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:52.242727 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bbd2c79b-f199-4abe-a5ec-7f8e38eed989 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:52.252122 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bbd2c79b-f199-4abe-a5ec-7f8e38eed989 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1579 microversion: 2.1 time: 0.438047 Jun 28 12:10:52.252707 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 327/618] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:51 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1579 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:52.434288 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-48eb39c3-5e61-468b-9094-4d672e1210a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:52.435420 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-48eb39c3-5e61-468b-9094-4d672e1210a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:52.445594 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48eb39c3-5e61-468b-9094-4d672e1210a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:52.446317 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48eb39c3-5e61-468b-9094-4d672e1210a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:52.447478 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48eb39c3-5e61-468b-9094-4d672e1210a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:52.447914 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-48eb39c3-5e61-468b-9094-4d672e1210a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:52.478042 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-48eb39c3-5e61-468b-9094-4d672e1210a3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049533 Jun 28 12:10:52.478843 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 292/619] 10.222.0.55 () {60 vars in 1342 bytes} [Tue Jun 28 12:10:52 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:52.537895 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a473061d-38d4-4405-94e7-cf74ba410963 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:52.538476 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a473061d-38d4-4405-94e7-cf74ba410963 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:52.545669 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a473061d-38d4-4405-94e7-cf74ba410963 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:52.546462 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a473061d-38d4-4405-94e7-cf74ba410963 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:52.547315 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a473061d-38d4-4405-94e7-cf74ba410963 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:52.547748 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a473061d-38d4-4405-94e7-cf74ba410963 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:52.575313 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a473061d-38d4-4405-94e7-cf74ba410963 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:10:52.658663 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a473061d-38d4-4405-94e7-cf74ba410963 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "DELETE /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 204 len: 0 microversion: 2.20 time: 0.124439 Jun 28 12:10:52.659257 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 328/620] 10.222.0.55 () {60 vars in 1279 bytes} [Tue Jun 28 12:10:52 2022] DELETE /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 28 12:10:52.668013 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-135663d3-886e-4162-96a1-1ac69f8aedf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:52.668630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-135663d3-886e-4162-96a1-1ac69f8aedf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:52.674741 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-135663d3-886e-4162-96a1-1ac69f8aedf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:52.675889 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-135663d3-886e-4162-96a1-1ac69f8aedf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:52.675976 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-135663d3-886e-4162-96a1-1ac69f8aedf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:52.676363 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-135663d3-886e-4162-96a1-1ac69f8aedf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:52.809461 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-135663d3-886e-4162-96a1-1ac69f8aedf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:52.817906 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-135663d3-886e-4162-96a1-1ac69f8aedf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:52.819399 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-135663d3-886e-4162-96a1-1ac69f8aedf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:52.820568 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-135663d3-886e-4162-96a1-1ac69f8aedf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.156724 Jun 28 12:10:52.821971 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 293/621] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:10:52 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:10:52.984209 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-93ae1673-de5d-4911-a23c-204d5dff6e00 req-62185415-5abf-4aef-ae7b-5ad054b6c9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3b43f9-d11c-431b-ae03-a6d4e7186040", "name": "network-vif-deleted", "tag": "ff58ffa6-bb00-4617-a737-e6a53540ec91"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:10:52.992609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-93ae1673-de5d-4911-a23c-204d5dff6e00 req-62185415-5abf-4aef-ae7b-5ad054b6c9f7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:52.993130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-93ae1673-de5d-4911-a23c-204d5dff6e00 req-62185415-5abf-4aef-ae7b-5ad054b6c9f7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:53.005073 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-93ae1673-de5d-4911-a23c-204d5dff6e00 req-62185415-5abf-4aef-ae7b-5ad054b6c9f7 service nova] Creating event network-vif-deleted:ff58ffa6-bb00-4617-a737-e6a53540ec91 for instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 on hv-cinder-84795 Jun 28 12:10:53.010881 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-93ae1673-de5d-4911-a23c-204d5dff6e00 req-62185415-5abf-4aef-ae7b-5ad054b6c9f7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030707 Jun 28 12:10:53.011475 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 329/622] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:10:53.269695 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d97a021c-1c58-425c-8a7f-004d26ff3cec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:53.270709 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d97a021c-1c58-425c-8a7f-004d26ff3cec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:53.277514 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d97a021c-1c58-425c-8a7f-004d26ff3cec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:53.278235 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d97a021c-1c58-425c-8a7f-004d26ff3cec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:53.278973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d97a021c-1c58-425c-8a7f-004d26ff3cec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:53.279605 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d97a021c-1c58-425c-8a7f-004d26ff3cec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:53.343337 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d97a021c-1c58-425c-8a7f-004d26ff3cec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:53.350981 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d97a021c-1c58-425c-8a7f-004d26ff3cec tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1511 microversion: 2.1 time: 0.085198 Jun 28 12:10:53.351534 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 294/623] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:53 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1511 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:53.841083 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-33cce5c8-e817-44c6-81ca-61dc4db02df0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:53.841791 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-33cce5c8-e817-44c6-81ca-61dc4db02df0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:53.848305 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33cce5c8-e817-44c6-81ca-61dc4db02df0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:53.848787 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33cce5c8-e817-44c6-81ca-61dc4db02df0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:53.849552 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33cce5c8-e817-44c6-81ca-61dc4db02df0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:53.850259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-33cce5c8-e817-44c6-81ca-61dc4db02df0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:53.989961 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-33cce5c8-e817-44c6-81ca-61dc4db02df0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:53.998821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-33cce5c8-e817-44c6-81ca-61dc4db02df0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:54.000642 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-33cce5c8-e817-44c6-81ca-61dc4db02df0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:54.001852 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-33cce5c8-e817-44c6-81ca-61dc4db02df0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.165458 Jun 28 12:10:54.002407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 330/624] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:10:53 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:10:54.367845 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e5a32099-c917-495f-b089-e9916e63cd86 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:54.368694 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e5a32099-c917-495f-b089-e9916e63cd86 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:54.375691 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5a32099-c917-495f-b089-e9916e63cd86 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:54.376149 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5a32099-c917-495f-b089-e9916e63cd86 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:54.376954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5a32099-c917-495f-b089-e9916e63cd86 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:54.377410 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e5a32099-c917-495f-b089-e9916e63cd86 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:54.442080 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e5a32099-c917-495f-b089-e9916e63cd86 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:54.449917 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e5a32099-c917-495f-b089-e9916e63cd86 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 200 len: 1226 microversion: 2.1 time: 0.086012 Jun 28 12:10:54.454832 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 295/625] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:54 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:55.019913 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e61fdea1-b934-452e-97a4-66973f318a8e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:55.020693 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e61fdea1-b934-452e-97a4-66973f318a8e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:55.032397 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e61fdea1-b934-452e-97a4-66973f318a8e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:55.032927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e61fdea1-b934-452e-97a4-66973f318a8e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:55.033906 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e61fdea1-b934-452e-97a4-66973f318a8e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:55.034437 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e61fdea1-b934-452e-97a4-66973f318a8e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:55.332321 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e61fdea1-b934-452e-97a4-66973f318a8e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:55.342558 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e61fdea1-b934-452e-97a4-66973f318a8e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:55.344058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e61fdea1-b934-452e-97a4-66973f318a8e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:55.345268 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e61fdea1-b934-452e-97a4-66973f318a8e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1723 microversion: 2.20 time: 0.329418 Jun 28 12:10:55.345831 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 331/626] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:10:55 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:10:55.468236 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ea009a87-c6d5-4269-aaa2-43f458e97511 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:55.469473 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ea009a87-c6d5-4269-aaa2-43f458e97511 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:55.476703 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea009a87-c6d5-4269-aaa2-43f458e97511 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:55.477422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea009a87-c6d5-4269-aaa2-43f458e97511 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:55.478606 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea009a87-c6d5-4269-aaa2-43f458e97511 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:55.479263 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea009a87-c6d5-4269-aaa2-43f458e97511 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:55.494833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-ea009a87-c6d5-4269-aaa2-43f458e97511 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] HTTP exception thrown: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ea009a87-c6d5-4269-aaa2-43f458e97511 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Request method failure captured: Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 HTTP/1.1 Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu6TPkyDoQDpQA0MtA9LR9_EgxFhSkUHquhjJKI9zi6VeD6zzaRBGURBas0KoAf_Ql0E3AaSSd8ZnMXILkrhjUuLRgfbyH9CQv45qZ6QGt0YUqBClpMDCHRclB7exGeK2f_l-3SwhpepN7_ncoMMxnMuwMmEezWVpBfdBoMWrVc_eLc Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 7235a9c7eff24e0e94900ec2abc92ae5 Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestVolumeBootPattern-592497969 Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:10:55.496667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7235a9c7eff24e0e94900ec2abc92ae5"}]}] Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestVolumeBootPattern-592497969 Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 7235a9c7eff24e0e94900ec2abc92ae5 Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestVolumeBootPattern-592497969 Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-TestVolumeBootPattern-592497969-project Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: 9f56095d6bac4f108a73790ac9004f3b Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestVolumeBootPattern-592497969-project Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:10:55.498140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '7d3b43f9-d11c-431b-ae03-a6d4e7186040'} Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:10:55.498973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:10:55.500223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:10:55.501374 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ea009a87-c6d5-4269-aaa2-43f458e97511 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Returning 404 to user: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:10:55.501374 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ea009a87-c6d5-4269-aaa2-43f458e97511 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 404 len: 111 microversion: 2.1 time: 0.033852 Jun 28 12:10:55.501374 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 296/627] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:55 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:10:55.551127 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1953910403", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1512622342", "security_groups": [{"name": "tempest-secgroup-smoke-1078744139"}], "block_device_mapping_v2": [{"uuid": "edd5f7c6-4c2f-4a35-b4ce-f6b79994ce66", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "460be620-b015-4979-a780-ce463435c616"}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:10:55.693724 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] validate_networks() for [('460be620-b015-4979-a780-ce463435c616', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:10:55.939229 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-d871de2e-6f21-43d9-99c3-40d018d32ea9 req-9e95df50-e3e7-4825-9468-8b1555999cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350964d7-7d2a-4335-b45e-c50e8cd87f7d", "name": "network-vif-deleted", "tag": "5f8ebf1b-007a-4caf-9a83-c43616b46917"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:10:55.950000 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d871de2e-6f21-43d9-99c3-40d018d32ea9 req-9e95df50-e3e7-4825-9468-8b1555999cf7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:55.950902 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d871de2e-6f21-43d9-99c3-40d018d32ea9 req-9e95df50-e3e7-4825-9468-8b1555999cf7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:55.965067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-d871de2e-6f21-43d9-99c3-40d018d32ea9 req-9e95df50-e3e7-4825-9468-8b1555999cf7 service nova] Creating event network-vif-deleted:5f8ebf1b-007a-4caf-9a83-c43616b46917 for instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d on hv-cinder-84795 Jun 28 12:10:55.970657 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-d871de2e-6f21-43d9-99c3-40d018d32ea9 req-9e95df50-e3e7-4825-9468-8b1555999cf7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035232 Jun 28 12:10:55.971933 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 297/628] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:10:56.260790 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:10:56.261345 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:10:56.261808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:10:56.262236 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:10:56.262636 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:10:56.272308 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:56.272750 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:56.273554 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:56.273979 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:56.292441 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Getting quotas for project 7235a9c7eff24e0e94900ec2abc92ae5. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:10:56.296587 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Getting quotas for user 9f56095d6bac4f108a73790ac9004f3b and project 7235a9c7eff24e0e94900ec2abc92ae5. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:10:56.358995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:10:56.361137 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edd5f7c6-4c2f-4a35-b4ce-f6b79994ce66',volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:10:56.364433 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:56.365302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:56.372853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:56.373560 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:56.374356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:56.374750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:56.423208 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:56.423524 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:56.423981 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lazy-loading 'fault' on Instance uuid 350964d7-7d2a-4335-b45e-c50e8cd87f7d {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:10:56.476556 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:56.491641 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:56.494520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:56.496130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-deec7c92-3722-48f3-8f5f-2dbdda9949ba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 200 len: 1372 microversion: 2.20 time: 0.136007 Jun 28 12:10:56.496875 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 298/629] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:10:56 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 1372 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:10:56.531178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-48eddbcd-1462-4e91-b250-8e3075d858db tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.985085 Jun 28 12:10:56.531879 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 332/630] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:10:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:10:56.542042 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8919d076-c942-4084-868a-b2c8d2270a01 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:56.542855 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8919d076-c942-4084-868a-b2c8d2270a01 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:56.621727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8919d076-c942-4084-868a-b2c8d2270a01 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:56.629744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8919d076-c942-4084-868a-b2c8d2270a01 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1095 microversion: 2.1 time: 0.091751 Jun 28 12:10:56.630680 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 299/631] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:56 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:10:57.516190 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b3e7da2b-43d9-4e8b-861f-efbc264d2cd4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:57.516828 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b3e7da2b-43d9-4e8b-861f-efbc264d2cd4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:57.524458 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b3e7da2b-43d9-4e8b-861f-efbc264d2cd4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:57.524923 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b3e7da2b-43d9-4e8b-861f-efbc264d2cd4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:57.525686 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b3e7da2b-43d9-4e8b-861f-efbc264d2cd4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:57.526429 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b3e7da2b-43d9-4e8b-861f-efbc264d2cd4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:57.539967 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-b3e7da2b-43d9-4e8b-861f-efbc264d2cd4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] HTTP exception thrown: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b3e7da2b-43d9-4e8b-861f-efbc264d2cd4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Request method failure captured: Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d HTTP/1.1 Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5VPs3zIsq_7F49XLI1p5lweATsiT4C-aWMMe-K9M_SizQv98XbrP44yVFIqXI7PZRVq6eu7tRJJDN4fayDF4odSde-PU-cmf0Q7CbfW4c5apeH86f9TJm6nNN1o-PAssHbBOLpGzsAB9XMXWAz0xkKfA9tyHxJpHmtWd4yaijB3MY Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:10:57.541859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}] Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 702dcd49668c4680b5bf3c1c75575ab7 Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:10:57.543423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '350964d7-7d2a-4335-b45e-c50e8cd87f7d'} Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:10:57.544351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:10:57.545719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:10:57.547013 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b3e7da2b-43d9-4e8b-861f-efbc264d2cd4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Returning 404 to user: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:10:57.547013 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b3e7da2b-43d9-4e8b-861f-efbc264d2cd4 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 404 len: 111 microversion: 2.20 time: 0.032523 Jun 28 12:10:57.547302 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 333/632] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:10:57 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 12:10:57.555574 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-155dc3a1-f958-4673-a89b-c1d36503d436 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '.version_select at 0x7f3932ca2790>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:57.575794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-155dc3a1-f958-4673-a89b-c1d36503d436 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349213626" status: 204 len: 0 microversion: 2.20 time: 0.024771 Jun 28 12:10:57.576353 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 300/633] 10.222.0.55 () {60 vars in 1261 bytes} [Tue Jun 28 12:10:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349213626 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 28 12:10:57.646875 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-31d0d4fc-6557-44cd-88af-d820790f1256 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:57.647718 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-31d0d4fc-6557-44cd-88af-d820790f1256 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:57.654440 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-31d0d4fc-6557-44cd-88af-d820790f1256 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:57.655381 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-31d0d4fc-6557-44cd-88af-d820790f1256 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:57.655857 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-31d0d4fc-6557-44cd-88af-d820790f1256 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:57.656300 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-31d0d4fc-6557-44cd-88af-d820790f1256 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:57.759657 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-31d0d4fc-6557-44cd-88af-d820790f1256 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:57.772000 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-31d0d4fc-6557-44cd-88af-d820790f1256 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1201 microversion: 2.1 time: 0.129068 Jun 28 12:10:57.772574 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 334/634] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:57 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1201 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:58.580985 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-82b90b33-dccf-4b0e-808d-660298343cf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Action: 'create', calling method: .version_select at 0x7f3932c228b0>, body: {"keypair": {"name": "tempest-keypair-1210689827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1UWm0ECqZs9VK5gOUuIFAb+88/pkj68UO03MPwqyZ7mJ9Xd9gAxVZobJ1lNVWq/62hV1oQ1csKQnz+OB3bdFD8cIoIG+IcRfjgCj+kL5yO786Iiy4CkjSZyao8WRAScQ=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:10:58.599142 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-82b90b33-dccf-4b0e-808d-660298343cf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Getting quotas for project cb27799cde2e4258a2eedc5bda555c61. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:10:58.613007 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-82b90b33-dccf-4b0e-808d-660298343cf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Getting quotas for user 702dcd49668c4680b5bf3c1c75575ab7 and project cb27799cde2e4258a2eedc5bda555c61. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:10:58.649017 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-82b90b33-dccf-4b0e-808d-660298343cf5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.073766 Jun 28 12:10:58.650145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 301/635] 10.222.0.55 () {62 vars in 1199 bytes} [Tue Jun 28 12:10:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 28 12:10:58.794407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5b5bf393-59fe-4f56-81e5-3880065f1484 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:10:58.794980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5b5bf393-59fe-4f56-81e5-3880065f1484 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:10:58.805081 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b5bf393-59fe-4f56-81e5-3880065f1484 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:58.806239 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b5bf393-59fe-4f56-81e5-3880065f1484 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:58.807784 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b5bf393-59fe-4f56-81e5-3880065f1484 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:58.808371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5b5bf393-59fe-4f56-81e5-3880065f1484 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:59.054635 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5b5bf393-59fe-4f56-81e5-3880065f1484 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:10:59.071059 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5b5bf393-59fe-4f56-81e5-3880065f1484 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.284197 Jun 28 12:10:59.074022 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 335/636] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:10:58 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:10:59.269331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-fe6d81da-afb9-4fac-a6c7-7d009c6aefe5 req-bd54a684-5c50-4e45-8359-89e946c5495b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8576de0f-1773-4ebb-90d3-f8a05811e2e3", "tag": "63943ce2-4a0b-467c-adf0-ba864f08ad3c"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:10:59.281689 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-fe6d81da-afb9-4fac-a6c7-7d009c6aefe5 req-bd54a684-5c50-4e45-8359-89e946c5495b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:10:59.282628 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-fe6d81da-afb9-4fac-a6c7-7d009c6aefe5 req-bd54a684-5c50-4e45-8359-89e946c5495b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:10:59.298306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-fe6d81da-afb9-4fac-a6c7-7d009c6aefe5 req-bd54a684-5c50-4e45-8359-89e946c5495b service nova] Creating event network-changed:63943ce2-4a0b-467c-adf0-ba864f08ad3c for instance 8576de0f-1773-4ebb-90d3-f8a05811e2e3 on hv-cinder-84795 Jun 28 12:10:59.303805 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-fe6d81da-afb9-4fac-a6c7-7d009c6aefe5 req-bd54a684-5c50-4e45-8359-89e946c5495b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039488 Jun 28 12:10:59.305254 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 302/637] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:10:59.990744 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-609693779", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e8609e8-a972-43b0-88c4-e5c50e709831"}], "security_groups": [{"name": "tempest-securitygroup--851661052"}], "key_name": "tempest-keypair-1210689827", "user_data": "}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:00.093037 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6a4e50cc-4612-4d20-adec-0e8b7d96572c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:00.093700 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6a4e50cc-4612-4d20-adec-0e8b7d96572c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:00.096825 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] validate_networks() for [('4e8609e8-a972-43b0-88c4-e5c50e709831', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:11:00.100234 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a4e50cc-4612-4d20-adec-0e8b7d96572c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:00.100796 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a4e50cc-4612-4d20-adec-0e8b7d96572c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:00.101571 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a4e50cc-4612-4d20-adec-0e8b7d96572c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:00.102033 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a4e50cc-4612-4d20-adec-0e8b7d96572c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:00.238725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6a4e50cc-4612-4d20-adec-0e8b7d96572c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:00.247065 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6a4e50cc-4612-4d20-adec-0e8b7d96572c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.159565 Jun 28 12:11:00.247670 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 303/638] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:00 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:00.484469 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:11:00.484896 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:11:00.485411 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:11:00.485825 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:11:00.486234 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:11:00.495610 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:00.495943 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:00.496762 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:00.497241 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:00.514053 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Getting quotas for project cb27799cde2e4258a2eedc5bda555c61. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:11:00.517901 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Getting quotas for user 702dcd49668c4680b5bf3c1c75575ab7 and project cb27799cde2e4258a2eedc5bda555c61. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:11:00.530008 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:11:00.532129 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:11:00.585932 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f174f1e1-2c41-4b60-958d-fd5a8d68ea5e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.599076 Jun 28 12:11:00.586577 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 336/639] 10.222.0.55 () {62 vars in 1187 bytes} [Tue Jun 28 12:10:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 28 12:11:00.596848 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-acd1269a-5734-491b-9ab2-75e9dd019211 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:00.597483 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-acd1269a-5734-491b-9ab2-75e9dd019211 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:00.661594 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-acd1269a-5734-491b-9ab2-75e9dd019211 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:00.670314 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-acd1269a-5734-491b-9ab2-75e9dd019211 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:00.671805 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-acd1269a-5734-491b-9ab2-75e9dd019211 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:00.672927 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-acd1269a-5734-491b-9ab2-75e9dd019211 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1281 microversion: 2.20 time: 0.079866 Jun 28 12:11:00.673877 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 304/640] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:11:00 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:11:01.264549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a5980fa1-e1e6-4a39-814c-87f7704b6cc2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:01.265147 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a5980fa1-e1e6-4a39-814c-87f7704b6cc2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:01.272094 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5980fa1-e1e6-4a39-814c-87f7704b6cc2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:01.272527 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5980fa1-e1e6-4a39-814c-87f7704b6cc2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:01.273438 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5980fa1-e1e6-4a39-814c-87f7704b6cc2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:01.273898 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5980fa1-e1e6-4a39-814c-87f7704b6cc2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:01.429911 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a5980fa1-e1e6-4a39-814c-87f7704b6cc2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:01.439008 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a5980fa1-e1e6-4a39-814c-87f7704b6cc2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.179160 Jun 28 12:11:01.439571 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 337/641] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:01 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:01.691718 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1c992e25-2db1-468a-93ed-e1d951f2be17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:01.693063 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1c992e25-2db1-468a-93ed-e1d951f2be17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:01.701660 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c992e25-2db1-468a-93ed-e1d951f2be17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:01.702444 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c992e25-2db1-468a-93ed-e1d951f2be17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:01.703961 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c992e25-2db1-468a-93ed-e1d951f2be17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:01.704510 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c992e25-2db1-468a-93ed-e1d951f2be17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:01.778934 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1c992e25-2db1-468a-93ed-e1d951f2be17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:01.788194 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1c992e25-2db1-468a-93ed-e1d951f2be17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:01.790225 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1c992e25-2db1-468a-93ed-e1d951f2be17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:01.791337 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1c992e25-2db1-468a-93ed-e1d951f2be17 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1351 microversion: 2.20 time: 0.103864 Jun 28 12:11:01.791952 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 305/642] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:11:01 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:11:02.456000 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f771aa85-eab9-43ec-b9f7-16d93d34ab50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:02.456770 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f771aa85-eab9-43ec-b9f7-16d93d34ab50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:02.464940 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f771aa85-eab9-43ec-b9f7-16d93d34ab50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:02.465531 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f771aa85-eab9-43ec-b9f7-16d93d34ab50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:02.466375 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f771aa85-eab9-43ec-b9f7-16d93d34ab50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:02.467037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f771aa85-eab9-43ec-b9f7-16d93d34ab50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:02.724807 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f771aa85-eab9-43ec-b9f7-16d93d34ab50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:02.732824 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f771aa85-eab9-43ec-b9f7-16d93d34ab50 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.280872 Jun 28 12:11:02.733500 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 338/643] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:02 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:02.810171 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-afcd0e39-9fe0-491d-a233-f59bc1ce5ce1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:02.810737 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-afcd0e39-9fe0-491d-a233-f59bc1ce5ce1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:02.817582 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-afcd0e39-9fe0-491d-a233-f59bc1ce5ce1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:02.818157 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-afcd0e39-9fe0-491d-a233-f59bc1ce5ce1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:02.818931 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-afcd0e39-9fe0-491d-a233-f59bc1ce5ce1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:02.819351 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-afcd0e39-9fe0-491d-a233-f59bc1ce5ce1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:02.953260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-afcd0e39-9fe0-491d-a233-f59bc1ce5ce1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:02.962500 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-afcd0e39-9fe0-491d-a233-f59bc1ce5ce1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:02.964205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-afcd0e39-9fe0-491d-a233-f59bc1ce5ce1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:02.965586 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-afcd0e39-9fe0-491d-a233-f59bc1ce5ce1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1406 microversion: 2.20 time: 0.159472 Jun 28 12:11:02.966557 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 306/644] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:11:02 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:11:03.147940 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-955ff6b1-a880-43c3-acef-9c9f1f7d54ed req-b15b96fd-f481-4598-9ebe-9d54f2cbc1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905", "tag": "0facb1bd-c05b-4bcb-b042-f7de35787204"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:03.159359 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-955ff6b1-a880-43c3-acef-9c9f1f7d54ed req-b15b96fd-f481-4598-9ebe-9d54f2cbc1a8 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:03.159644 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-955ff6b1-a880-43c3-acef-9c9f1f7d54ed req-b15b96fd-f481-4598-9ebe-9d54f2cbc1a8 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:03.178560 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-955ff6b1-a880-43c3-acef-9c9f1f7d54ed req-b15b96fd-f481-4598-9ebe-9d54f2cbc1a8 service nova] Creating event network-changed:0facb1bd-c05b-4bcb-b042-f7de35787204 for instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 on hv-cinder-84795 Jun 28 12:11:03.183916 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-955ff6b1-a880-43c3-acef-9c9f1f7d54ed req-b15b96fd-f481-4598-9ebe-9d54f2cbc1a8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039560 Jun 28 12:11:03.184823 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 339/645] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:03.750594 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c0981bad-2157-4654-a8fb-5009872aa2e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:03.751109 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c0981bad-2157-4654-a8fb-5009872aa2e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:03.757721 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0981bad-2157-4654-a8fb-5009872aa2e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:03.758172 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0981bad-2157-4654-a8fb-5009872aa2e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:03.758943 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0981bad-2157-4654-a8fb-5009872aa2e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:03.759415 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0981bad-2157-4654-a8fb-5009872aa2e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:03.901335 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c0981bad-2157-4654-a8fb-5009872aa2e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:03.912576 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c0981bad-2157-4654-a8fb-5009872aa2e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.165704 Jun 28 12:11:03.913411 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 307/646] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:03 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:03.987998 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-dd743501-9b92-459b-b613-b4954a70803d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:03.988990 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-dd743501-9b92-459b-b613-b4954a70803d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:03.999214 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dd743501-9b92-459b-b613-b4954a70803d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:03.999916 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dd743501-9b92-459b-b613-b4954a70803d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:04.001344 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dd743501-9b92-459b-b613-b4954a70803d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:04.001937 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dd743501-9b92-459b-b613-b4954a70803d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:04.024077 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:04.146979 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dd743501-9b92-459b-b613-b4954a70803d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:04.156616 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dd743501-9b92-459b-b613-b4954a70803d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:04.158148 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dd743501-9b92-459b-b613-b4954a70803d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:04.159291 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-dd743501-9b92-459b-b613-b4954a70803d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1406 microversion: 2.20 time: 0.178563 Jun 28 12:11:04.159938 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 340/647] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:11:03 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:11:04.934275 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f133f80e-4e48-4bb9-894b-fb2fb18266a2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:04.934985 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f133f80e-4e48-4bb9-894b-fb2fb18266a2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:04.943629 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f133f80e-4e48-4bb9-894b-fb2fb18266a2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:04.944199 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f133f80e-4e48-4bb9-894b-fb2fb18266a2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:04.945200 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f133f80e-4e48-4bb9-894b-fb2fb18266a2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:04.945753 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f133f80e-4e48-4bb9-894b-fb2fb18266a2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:04.967931 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:05.092034 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f133f80e-4e48-4bb9-894b-fb2fb18266a2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:05.101179 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f133f80e-4e48-4bb9-894b-fb2fb18266a2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.173106 Jun 28 12:11:05.101728 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 308/648] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:04 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:05.177595 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5ec3c394-3907-4620-85c5-803338713de2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:05.178227 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5ec3c394-3907-4620-85c5-803338713de2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:05.185224 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ec3c394-3907-4620-85c5-803338713de2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:05.185674 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ec3c394-3907-4620-85c5-803338713de2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:05.186437 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ec3c394-3907-4620-85c5-803338713de2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:05.186882 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ec3c394-3907-4620-85c5-803338713de2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:05.329492 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5ec3c394-3907-4620-85c5-803338713de2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:05.342119 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5ec3c394-3907-4620-85c5-803338713de2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:05.344440 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5ec3c394-3907-4620-85c5-803338713de2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:05.346220 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5ec3c394-3907-4620-85c5-803338713de2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1406 microversion: 2.20 time: 0.172393 Jun 28 12:11:05.346995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 341/649] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:11:05 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:11:06.121703 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-55d76b90-0a7d-4c44-9276-2924daa5fc93 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:06.122465 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-55d76b90-0a7d-4c44-9276-2924daa5fc93 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:06.131794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55d76b90-0a7d-4c44-9276-2924daa5fc93 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:06.132399 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55d76b90-0a7d-4c44-9276-2924daa5fc93 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:06.133515 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55d76b90-0a7d-4c44-9276-2924daa5fc93 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:06.134129 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55d76b90-0a7d-4c44-9276-2924daa5fc93 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:06.278751 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-55d76b90-0a7d-4c44-9276-2924daa5fc93 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:06.289592 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-55d76b90-0a7d-4c44-9276-2924daa5fc93 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.172923 Jun 28 12:11:06.290457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 309/650] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:06 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:06.367782 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-93804a05-665d-421f-bb6e-0e8acf1dff50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:06.368356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-93804a05-665d-421f-bb6e-0e8acf1dff50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:06.376364 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-93804a05-665d-421f-bb6e-0e8acf1dff50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:06.376738 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-93804a05-665d-421f-bb6e-0e8acf1dff50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:06.377684 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-93804a05-665d-421f-bb6e-0e8acf1dff50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:06.378106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-93804a05-665d-421f-bb6e-0e8acf1dff50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:06.516572 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-93804a05-665d-421f-bb6e-0e8acf1dff50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:06.527587 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-93804a05-665d-421f-bb6e-0e8acf1dff50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:06.529262 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-93804a05-665d-421f-bb6e-0e8acf1dff50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:06.531127 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-93804a05-665d-421f-bb6e-0e8acf1dff50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1406 microversion: 2.20 time: 0.166747 Jun 28 12:11:06.531713 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 342/651] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:11:06 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:11:07.310361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-62e2e033-6b46-46a2-9a93-0cfdad7c0713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:07.310959 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-62e2e033-6b46-46a2-9a93-0cfdad7c0713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:07.317790 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62e2e033-6b46-46a2-9a93-0cfdad7c0713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:07.318244 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62e2e033-6b46-46a2-9a93-0cfdad7c0713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:07.319001 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62e2e033-6b46-46a2-9a93-0cfdad7c0713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:07.319438 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62e2e033-6b46-46a2-9a93-0cfdad7c0713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:07.457595 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-62e2e033-6b46-46a2-9a93-0cfdad7c0713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:07.465975 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-62e2e033-6b46-46a2-9a93-0cfdad7c0713 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.161307 Jun 28 12:11:07.466524 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 310/652] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:07 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:07.551219 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5ad204aa-05c2-49cf-b950-6323a4b98299 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:07.553236 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5ad204aa-05c2-49cf-b950-6323a4b98299 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:07.560802 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ad204aa-05c2-49cf-b950-6323a4b98299 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:07.561264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ad204aa-05c2-49cf-b950-6323a4b98299 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:07.562035 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ad204aa-05c2-49cf-b950-6323a4b98299 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:07.562469 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5ad204aa-05c2-49cf-b950-6323a4b98299 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:07.772605 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5ad204aa-05c2-49cf-b950-6323a4b98299 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:07.781049 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5ad204aa-05c2-49cf-b950-6323a4b98299 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:07.782563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5ad204aa-05c2-49cf-b950-6323a4b98299 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:07.783713 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5ad204aa-05c2-49cf-b950-6323a4b98299 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1406 microversion: 2.20 time: 0.237904 Jun 28 12:11:07.784240 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 343/653] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:11:07 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:11:08.484520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-53b062fe-c3b9-413a-99e9-b33bdab3a147 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:08.485345 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-53b062fe-c3b9-413a-99e9-b33bdab3a147 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:08.491519 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53b062fe-c3b9-413a-99e9-b33bdab3a147 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:08.491955 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53b062fe-c3b9-413a-99e9-b33bdab3a147 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:08.492764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53b062fe-c3b9-413a-99e9-b33bdab3a147 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:08.493216 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53b062fe-c3b9-413a-99e9-b33bdab3a147 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:08.633363 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-53b062fe-c3b9-413a-99e9-b33bdab3a147 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:08.641952 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-53b062fe-c3b9-413a-99e9-b33bdab3a147 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.162466 Jun 28 12:11:08.642547 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 311/654] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:08 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:08.802702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-81f0c51b-c4b5-4040-9b1c-4d42f13c8c6a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:08.803314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-81f0c51b-c4b5-4040-9b1c-4d42f13c8c6a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:08.816765 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81f0c51b-c4b5-4040-9b1c-4d42f13c8c6a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:08.817545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81f0c51b-c4b5-4040-9b1c-4d42f13c8c6a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:08.818343 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81f0c51b-c4b5-4040-9b1c-4d42f13c8c6a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:08.819037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81f0c51b-c4b5-4040-9b1c-4d42f13c8c6a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:08.901899 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-21472a69-d975-4df7-988e-a6ad4b7be9f0 req-a77154f6-8fd7-4d22-ad7d-87e3808d6e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905", "name": "network-vif-plugged", "status": "completed", "tag": "0facb1bd-c05b-4bcb-b042-f7de35787204"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:08.919226 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-21472a69-d975-4df7-988e-a6ad4b7be9f0 req-a77154f6-8fd7-4d22-ad7d-87e3808d6e73 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:08.919616 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-21472a69-d975-4df7-988e-a6ad4b7be9f0 req-a77154f6-8fd7-4d22-ad7d-87e3808d6e73 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:08.931941 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-21472a69-d975-4df7-988e-a6ad4b7be9f0 req-a77154f6-8fd7-4d22-ad7d-87e3808d6e73 service nova] Creating event network-vif-plugged:0facb1bd-c05b-4bcb-b042-f7de35787204 for instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 on hv-cinder-84795 Jun 28 12:11:08.938856 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-21472a69-d975-4df7-988e-a6ad4b7be9f0 req-a77154f6-8fd7-4d22-ad7d-87e3808d6e73 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128747 Jun 28 12:11:08.939467 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 312/655] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:08.965506 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-81f0c51b-c4b5-4040-9b1c-4d42f13c8c6a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:08.973798 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-81f0c51b-c4b5-4040-9b1c-4d42f13c8c6a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:08.975404 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-81f0c51b-c4b5-4040-9b1c-4d42f13c8c6a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:08.976522 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-81f0c51b-c4b5-4040-9b1c-4d42f13c8c6a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1406 microversion: 2.20 time: 0.177884 Jun 28 12:11:08.977098 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 344/656] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:11:08 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:11:09.663369 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-72d18056-47f1-403c-b18f-684e38424ad2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:09.664420 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-72d18056-47f1-403c-b18f-684e38424ad2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:09.675226 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72d18056-47f1-403c-b18f-684e38424ad2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:09.675912 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72d18056-47f1-403c-b18f-684e38424ad2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:09.677123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72d18056-47f1-403c-b18f-684e38424ad2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:09.677793 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-72d18056-47f1-403c-b18f-684e38424ad2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:09.819786 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-72d18056-47f1-403c-b18f-684e38424ad2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:09.828034 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-72d18056-47f1-403c-b18f-684e38424ad2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.171150 Jun 28 12:11:09.828604 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 313/657] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:09 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:09.994911 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-707afbf5-37de-4b9c-ab24-74f85d281103 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:09.995513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-707afbf5-37de-4b9c-ab24-74f85d281103 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:10.002894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-707afbf5-37de-4b9c-ab24-74f85d281103 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:10.003337 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-707afbf5-37de-4b9c-ab24-74f85d281103 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:10.004107 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-707afbf5-37de-4b9c-ab24-74f85d281103 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:10.004475 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-707afbf5-37de-4b9c-ab24-74f85d281103 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:10.141830 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-707afbf5-37de-4b9c-ab24-74f85d281103 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:10.153442 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-707afbf5-37de-4b9c-ab24-74f85d281103 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:10.154931 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-707afbf5-37de-4b9c-ab24-74f85d281103 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:10.156039 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-707afbf5-37de-4b9c-ab24-74f85d281103 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1406 microversion: 2.20 time: 0.165061 Jun 28 12:11:10.156609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 345/658] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:11:09 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:11:10.850987 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3b1f1987-682f-4520-9431-b9151cf706e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:10.851706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3b1f1987-682f-4520-9431-b9151cf706e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:10.853924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=8 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:10.860418 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b1f1987-682f-4520-9431-b9151cf706e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:10.860760 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b1f1987-682f-4520-9431-b9151cf706e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:10.861657 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b1f1987-682f-4520-9431-b9151cf706e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:10.862058 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b1f1987-682f-4520-9431-b9151cf706e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:10.869704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7589f2fe-0619-4e27-8b6a-7810bbd40e59 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1077003342"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:10.871245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7589f2fe-0619-4e27-8b6a-7810bbd40e59 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:10.877249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=4 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:10.878499 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=12 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:10.881568 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7589f2fe-0619-4e27-8b6a-7810bbd40e59 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:10.882370 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7589f2fe-0619-4e27-8b6a-7810bbd40e59 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:10.883317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7589f2fe-0619-4e27-8b6a-7810bbd40e59 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:10.884010 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7589f2fe-0619-4e27-8b6a-7810bbd40e59 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:11.020321 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3b1f1987-682f-4520-9431-b9151cf706e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:11.028663 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3b1f1987-682f-4520-9431-b9151cf706e3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.181353 Jun 28 12:11:11.029316 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 314/659] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:10 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:11.033836 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-9f68f53f-2270-4bac-9bbf-8d35fbfded06 req-80104b01-d3da-47e6-ae4b-d3f130039de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8576de0f-1773-4ebb-90d3-f8a05811e2e3", "name": "network-vif-plugged", "status": "completed", "tag": "63943ce2-4a0b-467c-adf0-ba864f08ad3c"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:11.041632 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.network.security_group_api [None req-7589f2fe-0619-4e27-8b6a-7810bbd40e59 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Removing security group fa9f9bd7-5594-4efc-b238-6c6bf20cf94b from port d4c7a854-153d-4c80-a397-448ffe963bca Jun 28 12:11:11.042100 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9f68f53f-2270-4bac-9bbf-8d35fbfded06 req-80104b01-d3da-47e6-ae4b-d3f130039de9 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:11.042302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9f68f53f-2270-4bac-9bbf-8d35fbfded06 req-80104b01-d3da-47e6-ae4b-d3f130039de9 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:11.053810 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-9f68f53f-2270-4bac-9bbf-8d35fbfded06 req-80104b01-d3da-47e6-ae4b-d3f130039de9 service nova] Creating event network-vif-plugged:63943ce2-4a0b-467c-adf0-ba864f08ad3c for instance 8576de0f-1773-4ebb-90d3-f8a05811e2e3 on hv-cinder-84795 Jun 28 12:11:11.058660 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-9f68f53f-2270-4bac-9bbf-8d35fbfded06 req-80104b01-d3da-47e6-ae4b-d3f130039de9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028155 Jun 28 12:11:11.059487 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 315/660] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:11.174799 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e3637b78-ea19-47b9-9bee-abf23c259930 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:11.175495 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e3637b78-ea19-47b9-9bee-abf23c259930 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:11.182428 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3637b78-ea19-47b9-9bee-abf23c259930 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:11.182877 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3637b78-ea19-47b9-9bee-abf23c259930 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:11.183644 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3637b78-ea19-47b9-9bee-abf23c259930 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:11.184536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3637b78-ea19-47b9-9bee-abf23c259930 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:11.326019 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3637b78-ea19-47b9-9bee-abf23c259930 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:11.334360 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3637b78-ea19-47b9-9bee-abf23c259930 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:11.336236 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3637b78-ea19-47b9-9bee-abf23c259930 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:11.337349 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e3637b78-ea19-47b9-9bee-abf23c259930 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1406 microversion: 2.20 time: 0.166822 Jun 28 12:11:11.337869 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 316/661] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:11:11 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:11:11.395768 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7589f2fe-0619-4e27-8b6a-7810bbd40e59 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "POST /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/action" status: 202 len: 0 microversion: 2.1 time: 0.530683 Jun 28 12:11:11.396635 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 346/662] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:11:10 2022] POST /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:11:11.412993 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-d5faff5b-6b64-4259-b34d-1e3517e7b596 req-824e2f22-d3c8-4bb6-b5d9-2a7dfca3a696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583b6c67-8700-4030-953d-58678d33b913", "tag": "d4c7a854-153d-4c80-a397-448ffe963bca"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:11.428921 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d5faff5b-6b64-4259-b34d-1e3517e7b596 req-824e2f22-d3c8-4bb6-b5d9-2a7dfca3a696 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:11.429413 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d5faff5b-6b64-4259-b34d-1e3517e7b596 req-824e2f22-d3c8-4bb6-b5d9-2a7dfca3a696 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:11.443583 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-d5faff5b-6b64-4259-b34d-1e3517e7b596 req-824e2f22-d3c8-4bb6-b5d9-2a7dfca3a696 service nova] Creating event network-changed:d4c7a854-153d-4c80-a397-448ffe963bca for instance 583b6c67-8700-4030-953d-58678d33b913 on hv-cinder-84795 Jun 28 12:11:11.449976 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-d5faff5b-6b64-4259-b34d-1e3517e7b596 req-824e2f22-d3c8-4bb6-b5d9-2a7dfca3a696 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042998 Jun 28 12:11:11.451170 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 317/663] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:12.046650 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1829206f-4875-4a9e-a250-43f3b135858b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:12.047241 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1829206f-4875-4a9e-a250-43f3b135858b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:12.054115 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1829206f-4875-4a9e-a250-43f3b135858b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:12.054546 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1829206f-4875-4a9e-a250-43f3b135858b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:12.055339 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1829206f-4875-4a9e-a250-43f3b135858b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:12.055765 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1829206f-4875-4a9e-a250-43f3b135858b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:12.357147 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4f110280-8244-4977-8b17-349abfdf514c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:12.357848 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4f110280-8244-4977-8b17-349abfdf514c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:12.365263 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f110280-8244-4977-8b17-349abfdf514c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:12.365712 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f110280-8244-4977-8b17-349abfdf514c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:12.367085 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f110280-8244-4977-8b17-349abfdf514c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:12.367530 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4f110280-8244-4977-8b17-349abfdf514c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:12.498002 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1829206f-4875-4a9e-a250-43f3b135858b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:12.505556 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4f110280-8244-4977-8b17-349abfdf514c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:12.505873 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1829206f-4875-4a9e-a250-43f3b135858b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.463848 Jun 28 12:11:12.506718 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 347/664] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:12 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:12.514387 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4f110280-8244-4977-8b17-349abfdf514c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:12.516018 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4f110280-8244-4977-8b17-349abfdf514c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:12.517288 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4f110280-8244-4977-8b17-349abfdf514c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1598 microversion: 2.20 time: 0.164650 Jun 28 12:11:12.517916 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 318/665] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:11:12 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:11:12.534923 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d88379eb-d504-4e3e-a089-b2bcf66c742b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:12.535418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d88379eb-d504-4e3e-a089-b2bcf66c742b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:12.541606 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d88379eb-d504-4e3e-a089-b2bcf66c742b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:12.542051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d88379eb-d504-4e3e-a089-b2bcf66c742b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:12.542803 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d88379eb-d504-4e3e-a089-b2bcf66c742b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:12.543269 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d88379eb-d504-4e3e-a089-b2bcf66c742b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:12.644078 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d88379eb-d504-4e3e-a089-b2bcf66c742b tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.112893 Jun 28 12:11:12.644821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 348/666] 10.222.0.55 () {60 vars in 1315 bytes} [Tue Jun 28 12:11:12 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 12:11:13.166692 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-15ac4802-f8ed-4a8e-96fa-c98ed28b08e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:13.167584 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-15ac4802-f8ed-4a8e-96fa-c98ed28b08e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:13.175375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15ac4802-f8ed-4a8e-96fa-c98ed28b08e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.176532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15ac4802-f8ed-4a8e-96fa-c98ed28b08e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.178089 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15ac4802-f8ed-4a8e-96fa-c98ed28b08e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.178769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15ac4802-f8ed-4a8e-96fa-c98ed28b08e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.320874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-15ac4802-f8ed-4a8e-96fa-c98ed28b08e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lazy-loading 'services' on Instance uuid 583b6c67-8700-4030-953d-58678d33b913 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:11:13.474991 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8875ed32-9ee1-406c-aeb8-d519a4e1d29c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:13.475997 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8875ed32-9ee1-406c-aeb8-d519a4e1d29c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:13.477150 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-15ac4802-f8ed-4a8e-96fa-c98ed28b08e0 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "DELETE /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments/538dae1e-70df-4cc0-8740-79a3736c4ccf" status: 202 len: 0 microversion: 2.1 time: 0.314588 Jun 28 12:11:13.480853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 319/667] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:11:13 2022] DELETE /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments/538dae1e-70df-4cc0-8740-79a3736c4ccf => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:11:13.486747 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a86e2aa4-2202-4d54-8cd2-2c0212ae4efe req-94eb52b3-e8c9-4c79-8f76-f7a85f439715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "583b6c67-8700-4030-953d-58678d33b913", "tag": "d4c7a854-153d-4c80-a397-448ffe963bca"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:13.489293 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8875ed32-9ee1-406c-aeb8-d519a4e1d29c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.490100 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8875ed32-9ee1-406c-aeb8-d519a4e1d29c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.491469 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8875ed32-9ee1-406c-aeb8-d519a4e1d29c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.492289 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8875ed32-9ee1-406c-aeb8-d519a4e1d29c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.496649 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a86e2aa4-2202-4d54-8cd2-2c0212ae4efe req-94eb52b3-e8c9-4c79-8f76-f7a85f439715 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.497241 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a86e2aa4-2202-4d54-8cd2-2c0212ae4efe req-94eb52b3-e8c9-4c79-8f76-f7a85f439715 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.511742 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a86e2aa4-2202-4d54-8cd2-2c0212ae4efe req-94eb52b3-e8c9-4c79-8f76-f7a85f439715 service nova] Creating event network-changed:d4c7a854-153d-4c80-a397-448ffe963bca for instance 583b6c67-8700-4030-953d-58678d33b913 on hv-cinder-84795 Jun 28 12:11:13.517783 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a86e2aa4-2202-4d54-8cd2-2c0212ae4efe req-94eb52b3-e8c9-4c79-8f76-f7a85f439715 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038397 Jun 28 12:11:13.518912 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 320/668] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:13.525607 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c2c4b925-1728-4cf0-a2bd-9a320348a45e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:13.526866 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c2c4b925-1728-4cf0-a2bd-9a320348a45e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:13.533728 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2c4b925-1728-4cf0-a2bd-9a320348a45e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.534460 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2c4b925-1728-4cf0-a2bd-9a320348a45e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.535446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2c4b925-1728-4cf0-a2bd-9a320348a45e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.536073 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2c4b925-1728-4cf0-a2bd-9a320348a45e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.601697 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c2c4b925-1728-4cf0-a2bd-9a320348a45e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081099 Jun 28 12:11:13.602629 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 321/669] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:11:13 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:13.616146 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2f4472dd-22d3-422b-a760-12885be0671a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:13.617792 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2f4472dd-22d3-422b-a760-12885be0671a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:13.628322 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f4472dd-22d3-422b-a760-12885be0671a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.629057 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f4472dd-22d3-422b-a760-12885be0671a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.630189 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f4472dd-22d3-422b-a760-12885be0671a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.631037 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f4472dd-22d3-422b-a760-12885be0671a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.699993 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-8875ed32-9ee1-406c-aeb8-d519a4e1d29c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lazy-loading 'services' on Instance uuid 820e4864-70b5-4a7e-bd0a-b33670b86066 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:11:13.821074 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8875ed32-9ee1-406c-aeb8-d519a4e1d29c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "DELETE /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments/70f141ee-b47f-413d-9dba-443819e9365f" status: 202 len: 0 microversion: 2.1 time: 0.350966 Jun 28 12:11:13.824889 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 349/670] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:11:13 2022] DELETE /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments/70f141ee-b47f-413d-9dba-443819e9365f => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:11:13.861415 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2f4472dd-22d3-422b-a760-12885be0671a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:13.870834 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2f4472dd-22d3-422b-a760-12885be0671a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1267 microversion: 2.1 time: 0.267087 Jun 28 12:11:13.871627 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 322/671] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:13 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1267 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:13.887291 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dc8aa03a-f4ad-455a-a2f3-02a7718fb388 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:13.888235 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dc8aa03a-f4ad-455a-a2f3-02a7718fb388 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:13.894640 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc8aa03a-f4ad-455a-a2f3-02a7718fb388 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.895098 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc8aa03a-f4ad-455a-a2f3-02a7718fb388 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.895874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc8aa03a-f4ad-455a-a2f3-02a7718fb388 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.896309 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc8aa03a-f4ad-455a-a2f3-02a7718fb388 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.913311 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-25ec8cdd-929b-4291-9900-e500525e06df req-bb824915-0d96-4b55-819b-cb328f7bb0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905", "tag": "0facb1bd-c05b-4bcb-b042-f7de35787204"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:13.921774 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-25ec8cdd-929b-4291-9900-e500525e06df req-bb824915-0d96-4b55-819b-cb328f7bb0cc service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:13.922273 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-25ec8cdd-929b-4291-9900-e500525e06df req-bb824915-0d96-4b55-819b-cb328f7bb0cc service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:13.934706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dc8aa03a-f4ad-455a-a2f3-02a7718fb388 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061881 Jun 28 12:11:13.934983 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-25ec8cdd-929b-4291-9900-e500525e06df req-bb824915-0d96-4b55-819b-cb328f7bb0cc service nova] Creating event network-changed:0facb1bd-c05b-4bcb-b042-f7de35787204 for instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 on hv-cinder-84795 Jun 28 12:11:13.935699 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 323/672] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:11:13 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:13.939871 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-25ec8cdd-929b-4291-9900-e500525e06df req-bb824915-0d96-4b55-819b-cb328f7bb0cc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116333 Jun 28 12:11:13.940528 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 350/673] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:14.614441 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-82a3acbb-1394-4521-a078-55bf4f139d0e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:14.615369 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-82a3acbb-1394-4521-a078-55bf4f139d0e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:14.622304 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82a3acbb-1394-4521-a078-55bf4f139d0e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:14.622801 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82a3acbb-1394-4521-a078-55bf4f139d0e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:14.623559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82a3acbb-1394-4521-a078-55bf4f139d0e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:14.624194 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82a3acbb-1394-4521-a078-55bf4f139d0e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:14.655117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-82a3acbb-1394-4521-a078-55bf4f139d0e tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044630 Jun 28 12:11:14.655673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 324/674] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:11:14 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:14.890419 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-90d95459-3e8a-4fd7-be19-a3ef24a5ff3f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:14.891115 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-90d95459-3e8a-4fd7-be19-a3ef24a5ff3f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:14.898132 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90d95459-3e8a-4fd7-be19-a3ef24a5ff3f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:14.898580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90d95459-3e8a-4fd7-be19-a3ef24a5ff3f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:14.899428 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90d95459-3e8a-4fd7-be19-a3ef24a5ff3f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:14.899872 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-90d95459-3e8a-4fd7-be19-a3ef24a5ff3f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:14.947586 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-11fb755a-f936-46be-96c1-700f8e2b20d3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:14.948519 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-11fb755a-f936-46be-96c1-700f8e2b20d3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:14.951720 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:14.956064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11fb755a-f936-46be-96c1-700f8e2b20d3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:14.956513 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11fb755a-f936-46be-96c1-700f8e2b20d3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:14.957759 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11fb755a-f936-46be-96c1-700f8e2b20d3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:14.958405 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11fb755a-f936-46be-96c1-700f8e2b20d3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:14.995969 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-11fb755a-f936-46be-96c1-700f8e2b20d3 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052605 Jun 28 12:11:15.000799 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 325/675] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:11:14 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:11:15.215578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-90d95459-3e8a-4fd7-be19-a3ef24a5ff3f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:15.223394 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-90d95459-3e8a-4fd7-be19-a3ef24a5ff3f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1453 microversion: 2.1 time: 0.337776 Jun 28 12:11:15.223976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 351/676] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:14 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1453 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:15.239687 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-73659942-db42-4e6a-830e-a01f550c395f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:15.240297 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-73659942-db42-4e6a-830e-a01f550c395f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:15.246411 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73659942-db42-4e6a-830e-a01f550c395f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:15.246872 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73659942-db42-4e6a-830e-a01f550c395f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:15.247641 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73659942-db42-4e6a-830e-a01f550c395f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:15.248096 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73659942-db42-4e6a-830e-a01f550c395f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:15.397624 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-73659942-db42-4e6a-830e-a01f550c395f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:15.405885 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-73659942-db42-4e6a-830e-a01f550c395f tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1453 microversion: 2.1 time: 0.170083 Jun 28 12:11:15.406452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 326/677] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:15 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:15.667227 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c139c89f-10b7-4bcf-a4ec-20535a340df9 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:15.668355 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c139c89f-10b7-4bcf-a4ec-20535a340df9 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:15.674947 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c139c89f-10b7-4bcf-a4ec-20535a340df9 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:15.675470 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c139c89f-10b7-4bcf-a4ec-20535a340df9 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:15.676332 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c139c89f-10b7-4bcf-a4ec-20535a340df9 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:15.676737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c139c89f-10b7-4bcf-a4ec-20535a340df9 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:15.705785 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c139c89f-10b7-4bcf-a4ec-20535a340df9 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Jun 28 12:11:15.706545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 352/678] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:11:15 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:16.007768 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eca6b3c4-22e8-4564-8d7c-21cdb843a39b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:16.008723 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eca6b3c4-22e8-4564-8d7c-21cdb843a39b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:16.023783 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eca6b3c4-22e8-4564-8d7c-21cdb843a39b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:16.024464 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eca6b3c4-22e8-4564-8d7c-21cdb843a39b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:16.025527 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eca6b3c4-22e8-4564-8d7c-21cdb843a39b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:16.026124 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eca6b3c4-22e8-4564-8d7c-21cdb843a39b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:16.031785 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:16.059730 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eca6b3c4-22e8-4564-8d7c-21cdb843a39b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055925 Jun 28 12:11:16.063643 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 327/679] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:11:16 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:16.718361 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1c37a8eb-4d85-421e-8a67-dcdb238a3bf3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:16.719319 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1c37a8eb-4d85-421e-8a67-dcdb238a3bf3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:16.722971 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:16.726738 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1c37a8eb-4d85-421e-8a67-dcdb238a3bf3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:16.727183 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1c37a8eb-4d85-421e-8a67-dcdb238a3bf3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:16.727950 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1c37a8eb-4d85-421e-8a67-dcdb238a3bf3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:16.728378 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1c37a8eb-4d85-421e-8a67-dcdb238a3bf3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:16.762359 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1c37a8eb-4d85-421e-8a67-dcdb238a3bf3 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048219 Jun 28 12:11:16.763284 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 353/680] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:11:16 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 12:11:16.773064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9dabc238-e4cc-44f8-a19e-e2770be99150 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:16.773825 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9dabc238-e4cc-44f8-a19e-e2770be99150 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:16.780675 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dabc238-e4cc-44f8-a19e-e2770be99150 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:16.781583 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dabc238-e4cc-44f8-a19e-e2770be99150 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:16.782348 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dabc238-e4cc-44f8-a19e-e2770be99150 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:16.782783 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dabc238-e4cc-44f8-a19e-e2770be99150 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:16.864162 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-9dabc238-e4cc-44f8-a19e-e2770be99150 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] HTTP exception thrown: Instance 583b6c67-8700-4030-953d-58678d33b913 is not attached to volume 538dae1e-70df-4cc0-8740-79a3736c4ccf Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9dabc238-e4cc-44f8-a19e-e2770be99150 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Request method failure captured: Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments/538dae1e-70df-4cc0-8740-79a3736c4ccf HTTP/1.1 Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu74BDhfeXrDkFhJVZw3SLx-OVz211BFYyRQarHU3jsMsTAgdxyAe2oBVXwH3f6-hJDSPt19xdOEWs1qPLcNwtd-xt2tnOggtNtMDASA8VueJx0GHaOE3V_Z0Viyucks-O2SD3aYnKs2UxWmEqmObBEhmk5D5aVWqdM4y9mUswDmpS8 Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 734fc82eeb014ad7b7bdb1c09236d44b Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestMinimumBasicScenario-943923353 Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:11:16.866681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:11:16.867996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/734fc82eeb014ad7b7bdb1c09236d44b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/734fc82eeb014ad7b7bdb1c09236d44b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_734fc82eeb014ad7b7bdb1c09236d44b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/734fc82eeb014ad7b7bdb1c09236d44b"}]}] Jun 28 12:11:16.867996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestMinimumBasicScenario-943923353 Jun 28 12:11:16.867996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 734fc82eeb014ad7b7bdb1c09236d44b Jun 28 12:11:16.867996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestMinimumBasicScenario-943923353 Jun 28 12:11:16.867996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-TestMinimumBasicScenario-943923353-project Jun 28 12:11:16.867996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:11:16.867996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:11:16.867996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: a9728aa79bb04cf58ea266102a3a5119 Jun 28 12:11:16.867996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestMinimumBasicScenario-943923353-project Jun 28 12:11:16.867996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:11:16.867996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 583b6c67-8700-4030-953d-58678d33b913 is not attached to volume 538dae1e-70df-4cc0-8740-79a3736c4ccf Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'server_id': '583b6c67-8700-4030-953d-58678d33b913', 'id': '538dae1e-70df-4cc0-8740-79a3736c4ccf'} Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 538dae1e-70df-4cc0-8740-79a3736c4ccf. Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:16.872361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583b6c67-8700-4030-953d-58678d33b913 is not attached to volume 538dae1e-70df-4cc0-8740-79a3736c4ccf Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583b6c67-8700-4030-953d-58678d33b913 is not attached to volume 538dae1e-70df-4cc0-8740-79a3736c4ccf Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:16.873954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9dabc238-e4cc-44f8-a19e-e2770be99150 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Returning 404 to user: Instance 583b6c67-8700-4030-953d-58678d33b913 is not attached to volume 538dae1e-70df-4cc0-8740-79a3736c4ccf {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:16.874847 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9dabc238-e4cc-44f8-a19e-e2770be99150 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "DELETE /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments/538dae1e-70df-4cc0-8740-79a3736c4ccf" status: 404 len: 154 microversion: 2.1 time: 0.099132 Jun 28 12:11:16.874847 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 328/681] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:11:16 2022] DELETE /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913/os-volume_attachments/538dae1e-70df-4cc0-8740-79a3736c4ccf => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:11:17.071872 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-adfddc30-c771-4506-bddc-bda94c449206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:17.072814 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-adfddc30-c771-4506-bddc-bda94c449206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:17.079606 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-adfddc30-c771-4506-bddc-bda94c449206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:17.080168 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-adfddc30-c771-4506-bddc-bda94c449206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:17.081074 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-adfddc30-c771-4506-bddc-bda94c449206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:17.081580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-adfddc30-c771-4506-bddc-bda94c449206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:17.111937 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-adfddc30-c771-4506-bddc-bda94c449206 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044145 Jun 28 12:11:17.112516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 354/682] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:11:17 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 12:11:17.179758 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e61c2877-b878-41dd-a613-984f00565dc2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:17.180321 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e61c2877-b878-41dd-a613-984f00565dc2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:17.187178 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e61c2877-b878-41dd-a613-984f00565dc2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:17.187627 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e61c2877-b878-41dd-a613-984f00565dc2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:17.188433 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e61c2877-b878-41dd-a613-984f00565dc2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:17.188892 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e61c2877-b878-41dd-a613-984f00565dc2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:17.214405 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e61c2877-b878-41dd-a613-984f00565dc2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:11:17.296088 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e61c2877-b878-41dd-a613-984f00565dc2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "DELETE /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 204 len: 0 microversion: 2.1 time: 0.119954 Jun 28 12:11:17.296787 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 329/683] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:11:17 2022] DELETE /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:11:17.308153 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ffbccbcb-1288-4601-aa75-ad0edda9dc4f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:17.309197 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ffbccbcb-1288-4601-aa75-ad0edda9dc4f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:17.316697 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffbccbcb-1288-4601-aa75-ad0edda9dc4f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:17.317992 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffbccbcb-1288-4601-aa75-ad0edda9dc4f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:17.319337 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffbccbcb-1288-4601-aa75-ad0edda9dc4f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:17.319913 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ffbccbcb-1288-4601-aa75-ad0edda9dc4f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:17.328517 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a42b353f-3db6-44a4-a742-8f40004871c5 req-fd197c35-3847-400e-880e-7f3519dee4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8576de0f-1773-4ebb-90d3-f8a05811e2e3", "tag": "63943ce2-4a0b-467c-adf0-ba864f08ad3c"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:17.338811 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a42b353f-3db6-44a4-a742-8f40004871c5 req-fd197c35-3847-400e-880e-7f3519dee4c9 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:17.339338 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a42b353f-3db6-44a4-a742-8f40004871c5 req-fd197c35-3847-400e-880e-7f3519dee4c9 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:17.351086 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a42b353f-3db6-44a4-a742-8f40004871c5 req-fd197c35-3847-400e-880e-7f3519dee4c9 service nova] Creating event network-changed:63943ce2-4a0b-467c-adf0-ba864f08ad3c for instance 8576de0f-1773-4ebb-90d3-f8a05811e2e3 on hv-cinder-84795 Jun 28 12:11:17.356099 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a42b353f-3db6-44a4-a742-8f40004871c5 req-fd197c35-3847-400e-880e-7f3519dee4c9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031893 Jun 28 12:11:17.357052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 330/684] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:11:17.463761 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ffbccbcb-1288-4601-aa75-ad0edda9dc4f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:17.471390 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ffbccbcb-1288-4601-aa75-ad0edda9dc4f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1690 microversion: 2.1 time: 0.169482 Jun 28 12:11:17.471963 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 355/685] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:17 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:18.011275 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4dc573de-fc71-4174-8bd8-ea8a8eb85f41 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:18.011978 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4dc573de-fc71-4174-8bd8-ea8a8eb85f41 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:18.018718 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dc573de-fc71-4174-8bd8-ea8a8eb85f41 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:18.019257 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dc573de-fc71-4174-8bd8-ea8a8eb85f41 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:18.019947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dc573de-fc71-4174-8bd8-ea8a8eb85f41 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:18.020350 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dc573de-fc71-4174-8bd8-ea8a8eb85f41 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:18.051743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4dc573de-fc71-4174-8bd8-ea8a8eb85f41 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:11:18.131546 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4dc573de-fc71-4174-8bd8-ea8a8eb85f41 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "DELETE /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 204 len: 0 microversion: 2.1 time: 0.124238 Jun 28 12:11:18.132162 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 331/686] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:11:18 2022] DELETE /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:11:18.140789 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-94227188-4a8d-41a7-b8f7-3ed43b541894 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:18.141461 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-94227188-4a8d-41a7-b8f7-3ed43b541894 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:18.148370 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-94227188-4a8d-41a7-b8f7-3ed43b541894 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:18.148816 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-94227188-4a8d-41a7-b8f7-3ed43b541894 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:18.149717 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-94227188-4a8d-41a7-b8f7-3ed43b541894 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:18.150205 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-94227188-4a8d-41a7-b8f7-3ed43b541894 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:18.290106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-94227188-4a8d-41a7-b8f7-3ed43b541894 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:18.298462 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-94227188-4a8d-41a7-b8f7-3ed43b541894 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1555 microversion: 2.1 time: 0.161741 Jun 28 12:11:18.299131 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 356/687] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:18 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:18.493864 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a1c86dce-e569-4c3c-928b-1ca2f7f9e82b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:18.494785 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a1c86dce-e569-4c3c-928b-1ca2f7f9e82b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:18.502859 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1c86dce-e569-4c3c-928b-1ca2f7f9e82b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:18.503313 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1c86dce-e569-4c3c-928b-1ca2f7f9e82b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:18.504089 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1c86dce-e569-4c3c-928b-1ca2f7f9e82b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:18.504507 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1c86dce-e569-4c3c-928b-1ca2f7f9e82b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:18.649692 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a1c86dce-e569-4c3c-928b-1ca2f7f9e82b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:18.658155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a1c86dce-e569-4c3c-928b-1ca2f7f9e82b tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1690 microversion: 2.1 time: 0.171565 Jun 28 12:11:18.658738 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 332/688] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:18 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:19.319890 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-74055957-dbb0-42e0-a9aa-0e462c062997 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:19.320872 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-74055957-dbb0-42e0-a9aa-0e462c062997 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:19.339698 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-74055957-dbb0-42e0-a9aa-0e462c062997 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:19.340388 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-74055957-dbb0-42e0-a9aa-0e462c062997 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:19.341186 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-74055957-dbb0-42e0-a9aa-0e462c062997 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:19.341617 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-74055957-dbb0-42e0-a9aa-0e462c062997 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:19.478553 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-74055957-dbb0-42e0-a9aa-0e462c062997 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:19.483166 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:19.488164 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-74055957-dbb0-42e0-a9aa-0e462c062997 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1555 microversion: 2.1 time: 0.174748 Jun 28 12:11:19.488784 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 357/689] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:19 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:19.675835 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8bb64cd1-67c3-4ae9-be28-44e9e6da1cf6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:19.676450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8bb64cd1-67c3-4ae9-be28-44e9e6da1cf6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:19.683532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bb64cd1-67c3-4ae9-be28-44e9e6da1cf6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:19.684012 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bb64cd1-67c3-4ae9-be28-44e9e6da1cf6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:19.684775 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bb64cd1-67c3-4ae9-be28-44e9e6da1cf6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:19.685274 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bb64cd1-67c3-4ae9-be28-44e9e6da1cf6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:19.831296 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8bb64cd1-67c3-4ae9-be28-44e9e6da1cf6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:19.839242 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8bb64cd1-67c3-4ae9-be28-44e9e6da1cf6 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1690 microversion: 2.1 time: 0.167457 Jun 28 12:11:19.839803 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 333/690] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:19 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:20.506536 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7c7fdf7d-edda-465b-9c29-9699d3c24218 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:20.507174 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7c7fdf7d-edda-465b-9c29-9699d3c24218 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:20.514802 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c7fdf7d-edda-465b-9c29-9699d3c24218 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:20.515255 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c7fdf7d-edda-465b-9c29-9699d3c24218 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:20.516028 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c7fdf7d-edda-465b-9c29-9699d3c24218 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:20.516470 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c7fdf7d-edda-465b-9c29-9699d3c24218 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:20.653215 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7c7fdf7d-edda-465b-9c29-9699d3c24218 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:20.661161 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7c7fdf7d-edda-465b-9c29-9699d3c24218 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1555 microversion: 2.1 time: 0.159103 Jun 28 12:11:20.661711 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 358/691] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:20 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:20.857282 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a93c5488-bb50-4302-a902-4faa3542a591 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:20.857780 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a93c5488-bb50-4302-a902-4faa3542a591 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:20.864968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a93c5488-bb50-4302-a902-4faa3542a591 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:20.865452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a93c5488-bb50-4302-a902-4faa3542a591 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:20.866223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a93c5488-bb50-4302-a902-4faa3542a591 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:20.866662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a93c5488-bb50-4302-a902-4faa3542a591 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:21.005976 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a93c5488-bb50-4302-a902-4faa3542a591 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:21.014306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a93c5488-bb50-4302-a902-4faa3542a591 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1690 microversion: 2.1 time: 0.161283 Jun 28 12:11:21.014885 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 334/692] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:20 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:21.682057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3e550881-43f1-44fe-a3e3-40c3bf0e47d6 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:21.682975 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3e550881-43f1-44fe-a3e3-40c3bf0e47d6 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:21.691154 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3e550881-43f1-44fe-a3e3-40c3bf0e47d6 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:21.691595 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3e550881-43f1-44fe-a3e3-40c3bf0e47d6 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:21.692345 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3e550881-43f1-44fe-a3e3-40c3bf0e47d6 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:21.692761 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3e550881-43f1-44fe-a3e3-40c3bf0e47d6 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:21.843583 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3e550881-43f1-44fe-a3e3-40c3bf0e47d6 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:21.851628 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3e550881-43f1-44fe-a3e3-40c3bf0e47d6 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1555 microversion: 2.1 time: 0.175594 Jun 28 12:11:21.852205 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 359/693] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:21 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:22.035806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-009c9ee7-e4b0-42c8-a180-cf3fab9ecae2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:22.036671 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-009c9ee7-e4b0-42c8-a180-cf3fab9ecae2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:22.047014 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-009c9ee7-e4b0-42c8-a180-cf3fab9ecae2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:22.047497 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-009c9ee7-e4b0-42c8-a180-cf3fab9ecae2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:22.048262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-009c9ee7-e4b0-42c8-a180-cf3fab9ecae2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:22.048697 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-009c9ee7-e4b0-42c8-a180-cf3fab9ecae2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:22.182468 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-009c9ee7-e4b0-42c8-a180-cf3fab9ecae2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:22.190534 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-009c9ee7-e4b0-42c8-a180-cf3fab9ecae2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1690 microversion: 2.1 time: 0.161466 Jun 28 12:11:22.191100 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 335/694] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:22 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:22.870559 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d1c32cbd-3f9f-40f6-9904-1c06157bd9cf tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:22.871135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d1c32cbd-3f9f-40f6-9904-1c06157bd9cf tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:22.878132 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d1c32cbd-3f9f-40f6-9904-1c06157bd9cf tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:22.878569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d1c32cbd-3f9f-40f6-9904-1c06157bd9cf tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:22.879331 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d1c32cbd-3f9f-40f6-9904-1c06157bd9cf tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:22.879731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d1c32cbd-3f9f-40f6-9904-1c06157bd9cf tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:23.208493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e8626ff2-677d-42ff-9f0b-f33d682c8f67 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:23.209588 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e8626ff2-677d-42ff-9f0b-f33d682c8f67 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:23.219040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8626ff2-677d-42ff-9f0b-f33d682c8f67 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:23.219799 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8626ff2-677d-42ff-9f0b-f33d682c8f67 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:23.220943 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8626ff2-677d-42ff-9f0b-f33d682c8f67 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:23.221394 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8626ff2-677d-42ff-9f0b-f33d682c8f67 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:23.371908 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e8626ff2-677d-42ff-9f0b-f33d682c8f67 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:23.380144 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e8626ff2-677d-42ff-9f0b-f33d682c8f67 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1690 microversion: 2.1 time: 0.175753 Jun 28 12:11:23.380858 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 336/695] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:23 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:23.385068 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-d34d97c2-e98c-45c0-a7e2-629caec83cd4 req-81f6775a-f887-465b-b89a-f7c8378c1335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "583b6c67-8700-4030-953d-58678d33b913", "name": "network-vif-deleted", "tag": "d4c7a854-153d-4c80-a397-448ffe963bca"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:23.396801 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d34d97c2-e98c-45c0-a7e2-629caec83cd4 req-81f6775a-f887-465b-b89a-f7c8378c1335 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:23.397324 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d34d97c2-e98c-45c0-a7e2-629caec83cd4 req-81f6775a-f887-465b-b89a-f7c8378c1335 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:23.409867 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-d34d97c2-e98c-45c0-a7e2-629caec83cd4 req-81f6775a-f887-465b-b89a-f7c8378c1335 service nova] Creating event network-vif-deleted:d4c7a854-153d-4c80-a397-448ffe963bca for instance 583b6c67-8700-4030-953d-58678d33b913 on hv-cinder-84795 Jun 28 12:11:23.438154 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-d34d97c2-e98c-45c0-a7e2-629caec83cd4 req-81f6775a-f887-465b-b89a-f7c8378c1335 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056209 Jun 28 12:11:23.439145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 337/696] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:23.479659 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d1c32cbd-3f9f-40f6-9904-1c06157bd9cf tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9728aa79bb04cf58ea266102a3a5119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734fc82eeb014ad7b7bdb1c09236d44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:23.488169 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d1c32cbd-3f9f-40f6-9904-1c06157bd9cf tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 200 len: 1555 microversion: 2.1 time: 0.621447 Jun 28 12:11:23.488743 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 360/697] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:22 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 1555 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:24.113979 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a017877c-9123-49b4-bd02-963f56cab015 req-33f1bfc4-73fe-42ad-bf2f-5c5aa5f88dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820e4864-70b5-4a7e-bd0a-b33670b86066", "name": "network-vif-deleted", "tag": "c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:24.122366 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a017877c-9123-49b4-bd02-963f56cab015 req-33f1bfc4-73fe-42ad-bf2f-5c5aa5f88dc9 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:24.123954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a017877c-9123-49b4-bd02-963f56cab015 req-33f1bfc4-73fe-42ad-bf2f-5c5aa5f88dc9 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:24.136452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a017877c-9123-49b4-bd02-963f56cab015 req-33f1bfc4-73fe-42ad-bf2f-5c5aa5f88dc9 service nova] Creating event network-vif-deleted:c8f3f771-f6a6-4066-8fb3-e9ec1ec8635e for instance 820e4864-70b5-4a7e-bd0a-b33670b86066 on hv-cinder-84795 Jun 28 12:11:24.141844 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a017877c-9123-49b4-bd02-963f56cab015 req-33f1bfc4-73fe-42ad-bf2f-5c5aa5f88dc9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032186 Jun 28 12:11:24.142444 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 338/698] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:24.398656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ba11733e-85de-4442-b3ad-c805f4801af1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:24.399307 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ba11733e-85de-4442-b3ad-c805f4801af1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:24.406746 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba11733e-85de-4442-b3ad-c805f4801af1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:24.407302 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba11733e-85de-4442-b3ad-c805f4801af1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:24.408192 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba11733e-85de-4442-b3ad-c805f4801af1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:24.408620 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba11733e-85de-4442-b3ad-c805f4801af1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:24.440418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba11733e-85de-4442-b3ad-c805f4801af1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:24.440863 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba11733e-85de-4442-b3ad-c805f4801af1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:24.441338 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-ba11733e-85de-4442-b3ad-c805f4801af1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lazy-loading 'fault' on Instance uuid 820e4864-70b5-4a7e-bd0a-b33670b86066 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:11:24.488100 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ba11733e-85de-4442-b3ad-c805f4801af1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:24.496225 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ba11733e-85de-4442-b3ad-c805f4801af1 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 200 len: 1334 microversion: 2.1 time: 0.101552 Jun 28 12:11:24.496820 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 361/699] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:24 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:24.506671 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-980f4db5-3390-4668-9f7d-e4ff426a52cd tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:24.507399 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-980f4db5-3390-4668-9f7d-e4ff426a52cd tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] [instance: 583b6c67-8700-4030-953d-58678d33b913] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:24.514448 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-980f4db5-3390-4668-9f7d-e4ff426a52cd tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:24.514890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-980f4db5-3390-4668-9f7d-e4ff426a52cd tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:24.515672 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-980f4db5-3390-4668-9f7d-e4ff426a52cd tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:24.516092 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-980f4db5-3390-4668-9f7d-e4ff426a52cd tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:24.530128 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-980f4db5-3390-4668-9f7d-e4ff426a52cd tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] HTTP exception thrown: Instance 583b6c67-8700-4030-953d-58678d33b913 could not be found. Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-980f4db5-3390-4668-9f7d-e4ff426a52cd tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Request method failure captured: Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 HTTP/1.1 Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu74BDhfeXrDkFhJVZw3SLx-OVz211BFYyRQarHU3jsMsTAgdxyAe2oBVXwH3f6-hJDSPt19xdOEWs1qPLcNwtd-xt2tnOggtNtMDASA8VueJx0GHaOE3V_Z0Viyucks-O2SD3aYnKs2UxWmEqmObBEhmk5D5aVWqdM4y9mUswDmpS8 Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 734fc82eeb014ad7b7bdb1c09236d44b Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestMinimumBasicScenario-943923353 Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:11:24.531776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/734fc82eeb014ad7b7bdb1c09236d44b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/734fc82eeb014ad7b7bdb1c09236d44b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_734fc82eeb014ad7b7bdb1c09236d44b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/734fc82eeb014ad7b7bdb1c09236d44b"}]}] Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestMinimumBasicScenario-943923353 Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 734fc82eeb014ad7b7bdb1c09236d44b Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestMinimumBasicScenario-943923353 Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-TestMinimumBasicScenario-943923353-project Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: a9728aa79bb04cf58ea266102a3a5119 Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestMinimumBasicScenario-943923353-project Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 583b6c67-8700-4030-953d-58678d33b913 could not be found. Jun 28 12:11:24.533312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '583b6c67-8700-4030-953d-58678d33b913'} Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 583b6c67-8700-4030-953d-58678d33b913 could not be found. Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:24.534040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 583b6c67-8700-4030-953d-58678d33b913 could not be found. Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 583b6c67-8700-4030-953d-58678d33b913 could not be found. Jun 28 12:11:24.535239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:24.536325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-980f4db5-3390-4668-9f7d-e4ff426a52cd tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Returning 404 to user: Instance 583b6c67-8700-4030-953d-58678d33b913 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:24.536325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-980f4db5-3390-4668-9f7d-e4ff426a52cd tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913" status: 404 len: 111 microversion: 2.1 time: 0.030796 Jun 28 12:11:24.536325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 339/700] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:24 2022] GET /compute/v2.1/servers/583b6c67-8700-4030-953d-58678d33b913 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 12:11:24.542310 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4cb9bbec-14c7-4c2d-b5a8-c8cbb234c898 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] Calling method '.version_select at 0x7f3932ce43a0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:24.563000 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4cb9bbec-14c7-4c2d-b5a8-c8cbb234c898 tempest-TestMinimumBasicScenario-943923353 tempest-TestMinimumBasicScenario-943923353-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-933171235" status: 202 len: 0 microversion: 2.1 time: 0.024614 Jun 28 12:11:24.563582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 362/701] 10.222.0.55 () {58 vars in 1268 bytes} [Tue Jun 28 12:11:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-933171235 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:11:25.514154 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c2107160-c3a4-4208-a627-bf873f5a390c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:25.514861 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c2107160-c3a4-4208-a627-bf873f5a390c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 820e4864-70b5-4a7e-bd0a-b33670b86066] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:25.522074 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2107160-c3a4-4208-a627-bf873f5a390c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:25.522518 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2107160-c3a4-4208-a627-bf873f5a390c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:25.523317 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2107160-c3a4-4208-a627-bf873f5a390c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:25.523759 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2107160-c3a4-4208-a627-bf873f5a390c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:25.539869 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-c2107160-c3a4-4208-a627-bf873f5a390c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] HTTP exception thrown: Instance 820e4864-70b5-4a7e-bd0a-b33670b86066 could not be found. Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c2107160-c3a4-4208-a627-bf873f5a390c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Request method failure captured: Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 HTTP/1.1 Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu5VDlT0QvxPczxGxa6d8wis3CrxqdLDzd7bXGXutpaSUscJ5Gb-1pWgOZu6QxpID_XWgOURaK8-f2td6BRMTAb_uKmkJnYncQO3XENA9Wfl4DGALMI1JwB0ZHgXr5_-PKiSq-JQVwWMC9av7z2Ev1xD0QZ3LvBbAb5bvqKpzdYUVCU Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: c47f35f9ae5e4a55be23a84e3887b915 Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:11:25.541502 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c47f35f9ae5e4a55be23a84e3887b915"}]}] Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: c47f35f9ae5e4a55be23a84e3887b915 Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-ServerRescueNegativeTestJSON-690784627-project Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: 2a54e9db924c440da63c04052fe058e6 Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690784627-project Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 820e4864-70b5-4a7e-bd0a-b33670b86066 could not be found. Jun 28 12:11:25.542947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '820e4864-70b5-4a7e-bd0a-b33670b86066'} Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820e4864-70b5-4a7e-bd0a-b33670b86066 could not be found. Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:25.543726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820e4864-70b5-4a7e-bd0a-b33670b86066 could not be found. Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820e4864-70b5-4a7e-bd0a-b33670b86066 could not be found. Jun 28 12:11:25.546205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:25.548478 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c2107160-c3a4-4208-a627-bf873f5a390c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Returning 404 to user: Instance 820e4864-70b5-4a7e-bd0a-b33670b86066 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:25.548478 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c2107160-c3a4-4208-a627-bf873f5a390c tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066" status: 404 len: 111 microversion: 2.1 time: 0.033137 Jun 28 12:11:25.548478 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 340/702] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:25 2022] GET /compute/v2.1/servers/820e4864-70b5-4a7e-bd0a-b33670b86066 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:11:25.553769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-04c9ae10-1009-4f94-aafe-1b6b4d44cee9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '.version_select at 0x7f3932c29160>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:25.573227 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-04c9ae10-1009-4f94-aafe-1b6b4d44cee9 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754099897" status: 202 len: 0 microversion: 2.1 time: 0.024801 Jun 28 12:11:25.573789 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 363/703] 10.222.0.55 () {58 vars in 1217 bytes} [Tue Jun 28 12:11:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754099897 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:11:28.466381 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a74b0b19-27eb-4627-9860-a9e87139e53e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:28.467258 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a74b0b19-27eb-4627-9860-a9e87139e53e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:28.476980 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a74b0b19-27eb-4627-9860-a9e87139e53e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:28.477444 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a74b0b19-27eb-4627-9860-a9e87139e53e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:28.478214 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a74b0b19-27eb-4627-9860-a9e87139e53e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:28.478624 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a74b0b19-27eb-4627-9860-a9e87139e53e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:28.509068 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a74b0b19-27eb-4627-9860-a9e87139e53e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:11:28.595667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a74b0b19-27eb-4627-9860-a9e87139e53e tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 204 len: 0 microversion: 2.1 time: 0.132895 Jun 28 12:11:28.596264 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 341/704] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:11:28 2022] DELETE /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:11:28.604748 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fce7e94f-4224-4c51-8f1f-f0c529bd7db8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:28.605510 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fce7e94f-4224-4c51-8f1f-f0c529bd7db8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:28.612490 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fce7e94f-4224-4c51-8f1f-f0c529bd7db8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:28.612986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fce7e94f-4224-4c51-8f1f-f0c529bd7db8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:28.613766 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fce7e94f-4224-4c51-8f1f-f0c529bd7db8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:28.614190 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fce7e94f-4224-4c51-8f1f-f0c529bd7db8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:28.823683 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fce7e94f-4224-4c51-8f1f-f0c529bd7db8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:28.835249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fce7e94f-4224-4c51-8f1f-f0c529bd7db8 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1508 microversion: 2.1 time: 0.233843 Jun 28 12:11:28.836119 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 364/705] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:28 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:29.856074 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-81c92c85-5751-4914-87f0-d1bd5101e6bf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:29.857000 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-81c92c85-5751-4914-87f0-d1bd5101e6bf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:29.864293 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81c92c85-5751-4914-87f0-d1bd5101e6bf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:29.864741 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81c92c85-5751-4914-87f0-d1bd5101e6bf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:29.865706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81c92c85-5751-4914-87f0-d1bd5101e6bf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:29.866134 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81c92c85-5751-4914-87f0-d1bd5101e6bf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:29.870476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:30.023520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-81c92c85-5751-4914-87f0-d1bd5101e6bf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:30.033144 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-81c92c85-5751-4914-87f0-d1bd5101e6bf tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1508 microversion: 2.1 time: 0.181357 Jun 28 12:11:30.033724 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 342/706] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:29 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:31.045381 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-d1028951-725b-4a1e-9e3c-1e7a63aee428 req-1d55f681-08cf-4808-9220-43f1c42d3268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8e28f3-fac6-4e0d-87c5-2480dd846898", "name": "network-vif-deleted", "tag": "689820bb-e174-4537-8fa7-10a586085c72"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:31.050710 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-368e0a63-3953-4421-959f-30981701760a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:31.055434 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-368e0a63-3953-4421-959f-30981701760a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:31.061201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-d1028951-725b-4a1e-9e3c-1e7a63aee428 req-1d55f681-08cf-4808-9220-43f1c42d3268 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:31.061638 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-d1028951-725b-4a1e-9e3c-1e7a63aee428 req-1d55f681-08cf-4808-9220-43f1c42d3268 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:31.064647 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-368e0a63-3953-4421-959f-30981701760a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:31.069616 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-368e0a63-3953-4421-959f-30981701760a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:31.070627 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-368e0a63-3953-4421-959f-30981701760a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:31.071137 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-368e0a63-3953-4421-959f-30981701760a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:31.081997 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-d1028951-725b-4a1e-9e3c-1e7a63aee428 req-1d55f681-08cf-4808-9220-43f1c42d3268 service nova] Creating event network-vif-deleted:689820bb-e174-4537-8fa7-10a586085c72 for instance 0e8e28f3-fac6-4e0d-87c5-2480dd846898 on hv-cinder-84795 Jun 28 12:11:31.100366 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-d1028951-725b-4a1e-9e3c-1e7a63aee428 req-1d55f681-08cf-4808-9220-43f1c42d3268 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060625 Jun 28 12:11:31.100963 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 365/707] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:31.170659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-368e0a63-3953-4421-959f-30981701760a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:31.178938 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-368e0a63-3953-4421-959f-30981701760a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 200 len: 1466 microversion: 2.1 time: 0.132100 Jun 28 12:11:31.179515 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 343/708] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:31 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 1466 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:32.202127 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8bbb682b-e32d-4ad3-bbfd-441479713d2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:32.203291 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8bbb682b-e32d-4ad3-bbfd-441479713d2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 0e8e28f3-fac6-4e0d-87c5-2480dd846898] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:32.210217 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bbb682b-e32d-4ad3-bbfd-441479713d2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:32.210799 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bbb682b-e32d-4ad3-bbfd-441479713d2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:32.211802 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bbb682b-e32d-4ad3-bbfd-441479713d2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:32.212235 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8bbb682b-e32d-4ad3-bbfd-441479713d2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:32.226031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-8bbb682b-e32d-4ad3-bbfd-441479713d2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] HTTP exception thrown: Instance 0e8e28f3-fac6-4e0d-87c5-2480dd846898 could not be found. Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8bbb682b-e32d-4ad3-bbfd-441479713d2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Request method failure captured: Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 HTTP/1.1 Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5VDlT0QvxPczxGxa6d8wis3CrxqdLDzd7bXGXutpaSUscJ5Gb-1pWgOZu6QxpID_XWgOURaK8-f2td6BRMTAb_uKmkJnYncQO3XENA9Wfl4DGALMI1JwB0ZHgXr5_-PKiSq-JQVwWMC9av7z2Ev1xD0QZ3LvBbAb5bvqKpzdYUVCU Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: c47f35f9ae5e4a55be23a84e3887b915 Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:11:32.227759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c47f35f9ae5e4a55be23a84e3887b915"}]}] Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: c47f35f9ae5e4a55be23a84e3887b915 Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-ServerRescueNegativeTestJSON-690784627-project Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 2a54e9db924c440da63c04052fe058e6 Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690784627-project Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance 0e8e28f3-fac6-4e0d-87c5-2480dd846898 could not be found. Jun 28 12:11:32.229201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '0e8e28f3-fac6-4e0d-87c5-2480dd846898'} Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8e28f3-fac6-4e0d-87c5-2480dd846898 could not be found. Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:32.230126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8e28f3-fac6-4e0d-87c5-2480dd846898 could not be found. Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8e28f3-fac6-4e0d-87c5-2480dd846898 could not be found. Jun 28 12:11:32.231539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:32.233064 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8bbb682b-e32d-4ad3-bbfd-441479713d2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Returning 404 to user: Instance 0e8e28f3-fac6-4e0d-87c5-2480dd846898 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:32.233064 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8bbb682b-e32d-4ad3-bbfd-441479713d2a tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898" status: 404 len: 111 microversion: 2.1 time: 0.033212 Jun 28 12:11:32.233064 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 366/709] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:32 2022] GET /compute/v2.1/servers/0e8e28f3-fac6-4e0d-87c5-2480dd846898 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:11:32.238601 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b32f6d61-de10-4e25-802c-5b63616ab419 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:32.239126 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b32f6d61-de10-4e25-802c-5b63616ab419 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:32.246153 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b32f6d61-de10-4e25-802c-5b63616ab419 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:32.246684 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b32f6d61-de10-4e25-802c-5b63616ab419 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:32.247733 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b32f6d61-de10-4e25-802c-5b63616ab419 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:32.248337 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b32f6d61-de10-4e25-802c-5b63616ab419 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:32.274542 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b32f6d61-de10-4e25-802c-5b63616ab419 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:11:32.360770 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b32f6d61-de10-4e25-802c-5b63616ab419 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "DELETE /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 204 len: 0 microversion: 2.1 time: 0.125456 Jun 28 12:11:32.361706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 344/710] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:11:32 2022] DELETE /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:11:32.369647 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9587bd62-0218-4efe-b3a1-ca0491c22b8f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:32.370268 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9587bd62-0218-4efe-b3a1-ca0491c22b8f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:32.376335 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9587bd62-0218-4efe-b3a1-ca0491c22b8f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:32.376785 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9587bd62-0218-4efe-b3a1-ca0491c22b8f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:32.377593 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9587bd62-0218-4efe-b3a1-ca0491c22b8f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:32.378025 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9587bd62-0218-4efe-b3a1-ca0491c22b8f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:32.513415 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9587bd62-0218-4efe-b3a1-ca0491c22b8f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:32.521428 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9587bd62-0218-4efe-b3a1-ca0491c22b8f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.155593 Jun 28 12:11:32.522181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 367/711] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:32 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:33.541379 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7fa36fe2-8e9b-40a4-b171-6f0e5389f5a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:33.541996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7fa36fe2-8e9b-40a4-b171-6f0e5389f5a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:33.549013 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fa36fe2-8e9b-40a4-b171-6f0e5389f5a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:33.550007 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fa36fe2-8e9b-40a4-b171-6f0e5389f5a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:33.551028 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fa36fe2-8e9b-40a4-b171-6f0e5389f5a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:33.551692 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fa36fe2-8e9b-40a4-b171-6f0e5389f5a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:33.700143 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7fa36fe2-8e9b-40a4-b171-6f0e5389f5a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:33.708247 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7fa36fe2-8e9b-40a4-b171-6f0e5389f5a2 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.171932 Jun 28 12:11:33.708816 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 345/712] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:33 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:34.729976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d052d399-186c-4c30-a9e6-2277a84e9b7f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:34.730957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d052d399-186c-4c30-a9e6-2277a84e9b7f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:34.738317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d052d399-186c-4c30-a9e6-2277a84e9b7f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:34.738761 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d052d399-186c-4c30-a9e6-2277a84e9b7f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:34.739517 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d052d399-186c-4c30-a9e6-2277a84e9b7f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:34.739947 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d052d399-186c-4c30-a9e6-2277a84e9b7f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:34.882201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d052d399-186c-4c30-a9e6-2277a84e9b7f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:34.890503 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d052d399-186c-4c30-a9e6-2277a84e9b7f tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1522 microversion: 2.1 time: 0.167125 Jun 28 12:11:34.891159 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 368/713] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:34 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:35.861119 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-1d939e5e-c926-40e4-a84c-311b4fef1050 req-22d69e9d-0038-43d0-865b-c27717198846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46baa815-7582-46ae-a0ea-3d29be972512", "name": "network-vif-deleted", "tag": "5b57bf11-d959-4b21-a64c-807b0e2c9f63"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:35.869773 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1d939e5e-c926-40e4-a84c-311b4fef1050 req-22d69e9d-0038-43d0-865b-c27717198846 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:35.870215 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1d939e5e-c926-40e4-a84c-311b4fef1050 req-22d69e9d-0038-43d0-865b-c27717198846 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:35.883931 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-1d939e5e-c926-40e4-a84c-311b4fef1050 req-22d69e9d-0038-43d0-865b-c27717198846 service nova] Creating event network-vif-deleted:5b57bf11-d959-4b21-a64c-807b0e2c9f63 for instance 46baa815-7582-46ae-a0ea-3d29be972512 on hv-cinder-84795 Jun 28 12:11:35.888791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-1d939e5e-c926-40e4-a84c-311b4fef1050 req-22d69e9d-0038-43d0-865b-c27717198846 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031465 Jun 28 12:11:35.889419 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 346/714] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:35.907660 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7926acdd-2e15-4237-a99c-6a07f2057179 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:35.908274 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7926acdd-2e15-4237-a99c-6a07f2057179 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:35.914870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7926acdd-2e15-4237-a99c-6a07f2057179 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:35.915304 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7926acdd-2e15-4237-a99c-6a07f2057179 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:35.916105 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7926acdd-2e15-4237-a99c-6a07f2057179 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:35.916547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7926acdd-2e15-4237-a99c-6a07f2057179 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:35.989629 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7926acdd-2e15-4237-a99c-6a07f2057179 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a54e9db924c440da63c04052fe058e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47f35f9ae5e4a55be23a84e3887b915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:35.997644 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7926acdd-2e15-4237-a99c-6a07f2057179 tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 200 len: 1306 microversion: 2.1 time: 0.093788 Jun 28 12:11:35.998205 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 369/715] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:35 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:37.017924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c09e5774-8f1d-4efa-b10b-06bc4e1c7fdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:37.018613 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c09e5774-8f1d-4efa-b10b-06bc4e1c7fdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] [instance: 46baa815-7582-46ae-a0ea-3d29be972512] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:37.026171 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c09e5774-8f1d-4efa-b10b-06bc4e1c7fdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:37.026681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c09e5774-8f1d-4efa-b10b-06bc4e1c7fdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:37.027367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c09e5774-8f1d-4efa-b10b-06bc4e1c7fdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:37.027794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c09e5774-8f1d-4efa-b10b-06bc4e1c7fdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:37.041902 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-c09e5774-8f1d-4efa-b10b-06bc4e1c7fdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] HTTP exception thrown: Instance 46baa815-7582-46ae-a0ea-3d29be972512 could not be found. Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c09e5774-8f1d-4efa-b10b-06bc4e1c7fdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Request method failure captured: Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 HTTP/1.1 Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu5VDlT0QvxPczxGxa6d8wis3CrxqdLDzd7bXGXutpaSUscJ5Gb-1pWgOZu6QxpID_XWgOURaK8-f2td6BRMTAb_uKmkJnYncQO3XENA9Wfl4DGALMI1JwB0ZHgXr5_-PKiSq-JQVwWMC9av7z2Ev1xD0QZ3LvBbAb5bvqKpzdYUVCU Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: c47f35f9ae5e4a55be23a84e3887b915 Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:11:37.043521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_c47f35f9ae5e4a55be23a84e3887b915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/c47f35f9ae5e4a55be23a84e3887b915"}]}] Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: c47f35f9ae5e4a55be23a84e3887b915 Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690784627 Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-ServerRescueNegativeTestJSON-690784627-project Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: 2a54e9db924c440da63c04052fe058e6 Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690784627-project Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 46baa815-7582-46ae-a0ea-3d29be972512 could not be found. Jun 28 12:11:37.045050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '46baa815-7582-46ae-a0ea-3d29be972512'} Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46baa815-7582-46ae-a0ea-3d29be972512 could not be found. Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:37.045817 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46baa815-7582-46ae-a0ea-3d29be972512 could not be found. Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46baa815-7582-46ae-a0ea-3d29be972512 could not be found. Jun 28 12:11:37.047027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:37.048235 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c09e5774-8f1d-4efa-b10b-06bc4e1c7fdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] Returning 404 to user: Instance 46baa815-7582-46ae-a0ea-3d29be972512 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:37.048235 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c09e5774-8f1d-4efa-b10b-06bc4e1c7fdd tempest-ServerRescueNegativeTestJSON-690784627 tempest-ServerRescueNegativeTestJSON-690784627-project] 10.222.0.55 "GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512" status: 404 len: 111 microversion: 2.1 time: 0.033432 Jun 28 12:11:37.048235 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 347/716] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:37 2022] GET /compute/v2.1/servers/46baa815-7582-46ae-a0ea-3d29be972512 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:11:38.087988 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1ab49b96-1ee5-4678-9408-c20e826fd2a8 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:38.088958 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1ab49b96-1ee5-4678-9408-c20e826fd2a8 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:38.096299 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1ab49b96-1ee5-4678-9408-c20e826fd2a8 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:38.096779 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1ab49b96-1ee5-4678-9408-c20e826fd2a8 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:38.097750 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1ab49b96-1ee5-4678-9408-c20e826fd2a8 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:38.098245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1ab49b96-1ee5-4678-9408-c20e826fd2a8 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:38.130807 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1ab49b96-1ee5-4678-9408-c20e826fd2a8 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047210 Jun 28 12:11:38.133202 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 370/717] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:11:38 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 12:11:38.198769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fdee11d6-7aac-4a3f-a073-344c5f31d7d1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:38.200355 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fdee11d6-7aac-4a3f-a073-344c5f31d7d1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:38.207345 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdee11d6-7aac-4a3f-a073-344c5f31d7d1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:38.207933 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdee11d6-7aac-4a3f-a073-344c5f31d7d1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:38.208872 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdee11d6-7aac-4a3f-a073-344c5f31d7d1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:38.209500 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fdee11d6-7aac-4a3f-a073-344c5f31d7d1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:38.236726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fdee11d6-7aac-4a3f-a073-344c5f31d7d1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:11:38.323890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fdee11d6-7aac-4a3f-a073-344c5f31d7d1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 204 len: 0 microversion: 2.1 time: 0.129813 Jun 28 12:11:38.324673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 348/718] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:11:38 2022] DELETE /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:11:38.333172 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-49fcec84-99a3-4b85-88fe-f5f27d3db107 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:38.333876 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-49fcec84-99a3-4b85-88fe-f5f27d3db107 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:38.340525 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-49fcec84-99a3-4b85-88fe-f5f27d3db107 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:38.341130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-49fcec84-99a3-4b85-88fe-f5f27d3db107 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:38.342106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-49fcec84-99a3-4b85-88fe-f5f27d3db107 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:38.342603 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-49fcec84-99a3-4b85-88fe-f5f27d3db107 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:38.804298 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-49fcec84-99a3-4b85-88fe-f5f27d3db107 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:38.813024 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-49fcec84-99a3-4b85-88fe-f5f27d3db107 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1673 microversion: 2.1 time: 0.483809 Jun 28 12:11:38.813609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 371/719] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:38 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1673 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:39.830901 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9ebc7a33-2e5b-40c3-885b-4f81ee803eed tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:39.832576 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9ebc7a33-2e5b-40c3-885b-4f81ee803eed tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:39.842708 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ebc7a33-2e5b-40c3-885b-4f81ee803eed tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:39.843165 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ebc7a33-2e5b-40c3-885b-4f81ee803eed tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:39.843953 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ebc7a33-2e5b-40c3-885b-4f81ee803eed tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:39.844383 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ebc7a33-2e5b-40c3-885b-4f81ee803eed tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:40.008722 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9ebc7a33-2e5b-40c3-885b-4f81ee803eed tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:40.021854 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9ebc7a33-2e5b-40c3-885b-4f81ee803eed tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1673 microversion: 2.1 time: 0.194817 Jun 28 12:11:40.022809 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 349/720] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:39 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1673 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:40.766824 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-fea64abc-ca13-4b33-9201-ceccca64cad9 req-6c6f8263-d278-455c-936b-77be5057736f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed81e0c7-a44e-497b-bf2e-cf208dd340de", "name": "network-vif-deleted", "tag": "66e19dd9-9d9b-4c52-9617-acf66e3f62d9"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:40.776990 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-fea64abc-ca13-4b33-9201-ceccca64cad9 req-6c6f8263-d278-455c-936b-77be5057736f service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:40.777674 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-fea64abc-ca13-4b33-9201-ceccca64cad9 req-6c6f8263-d278-455c-936b-77be5057736f service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:40.792484 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-fea64abc-ca13-4b33-9201-ceccca64cad9 req-6c6f8263-d278-455c-936b-77be5057736f service nova] Creating event network-vif-deleted:66e19dd9-9d9b-4c52-9617-acf66e3f62d9 for instance ed81e0c7-a44e-497b-bf2e-cf208dd340de on hv-cinder-84795 Jun 28 12:11:40.799495 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-fea64abc-ca13-4b33-9201-ceccca64cad9 req-6c6f8263-d278-455c-936b-77be5057736f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036999 Jun 28 12:11:40.803758 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 372/721] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:41.040070 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d01f3208-f74b-45ef-bad2-7e23dc611091 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:41.041509 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d01f3208-f74b-45ef-bad2-7e23dc611091 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:41.049187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d01f3208-f74b-45ef-bad2-7e23dc611091 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:41.050043 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d01f3208-f74b-45ef-bad2-7e23dc611091 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:41.050489 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d01f3208-f74b-45ef-bad2-7e23dc611091 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:41.051039 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d01f3208-f74b-45ef-bad2-7e23dc611091 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:41.085576 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d01f3208-f74b-45ef-bad2-7e23dc611091 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:41.086435 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d01f3208-f74b-45ef-bad2-7e23dc611091 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:41.086998 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-d01f3208-f74b-45ef-bad2-7e23dc611091 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lazy-loading 'fault' on Instance uuid ed81e0c7-a44e-497b-bf2e-cf208dd340de {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:11:41.149074 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d01f3208-f74b-45ef-bad2-7e23dc611091 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:41.158601 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d01f3208-f74b-45ef-bad2-7e23dc611091 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 200 len: 1326 microversion: 2.1 time: 0.122519 Jun 28 12:11:41.168196 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 350/722] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:41 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:41.891572 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b7b2978c-cec3-4ae4-8d01-e3b672fabed6 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Action: 'create', calling method: .version_select at 0x7f3932d69940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1550401559", "metadata": {"Type": "work"}}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b7b2978c-cec3-4ae4-8d01-e3b672fabed6 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Request method failure captured: Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 122 Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu_98GC-ojY-0iW0Z_HF_JPARo-eLVlblyLGcelyM_BRWA-2DBlSqXTY2H-mu_e-hmQWROJs5Bf-SMbakwjPax2ERwcRXYz0YH-gVrkK4UkEpV8WO5EPq4Fi3rojewcNu_T8dSJp-slgATcnDEewTSea7WIHp5HXEOp684OoJaiFsqM Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:11:41.913156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}] Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: ecb66837ff6d450d8eb7f95d1e4bff32 Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1550401559", "metadata": {"Type": "work"}}} Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: Jun 28 12:11:41.914728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1550401559', 'metadata': {'Type': 'work'}}}} Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise error Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi '#$%' Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:41.915767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 28 12:11:41.917401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 28 12:11:41.918759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 28 12:11:41.918759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.918759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b7b2978c-cec3-4ae4-8d01-e3b672fabed6 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:41.918759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b7b2978c-cec3-4ae4-8d01-e3b672fabed6 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.145505 Jun 28 12:11:41.918759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 373/723] 10.222.0.55 () {60 vars in 1155 bytes} [Tue Jun 28 12:11:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 28 12:11:41.925466 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-446db73e-9f55-466e-b4d4-efaa65b100d6 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Action: 'create', calling method: .version_select at 0x7f3932a8a790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1440266297", "metadata": {"Type": "work"}}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-446db73e-9f55-466e-b4d4-efaa65b100d6 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Request method failure captured: Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 120 Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu_98GC-ojY-0iW0Z_HF_JPARo-eLVlblyLGcelyM_BRWA-2DBlSqXTY2H-mu_e-hmQWROJs5Bf-SMbakwjPax2ERwcRXYz0YH-gVrkK4UkEpV8WO5EPq4Fi3rojewcNu_T8dSJp-slgATcnDEewTSea7WIHp5HXEOp684OoJaiFsqM Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:11:41.929032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}] Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: ecb66837ff6d450d8eb7f95d1e4bff32 Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1440266297", "metadata": {"Type": "work"}}} Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: Jun 28 12:11:41.930587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1440266297', 'metadata': {'Type': 'work'}}}} Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise error Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi '0' Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:41.931493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 28 12:11:41.933260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 28 12:11:41.935084 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 28 12:11:41.935084 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.935084 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-446db73e-9f55-466e-b4d4-efaa65b100d6 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:41.935084 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-446db73e-9f55-466e-b4d4-efaa65b100d6 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008941 Jun 28 12:11:41.935084 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 351/724] 10.222.0.55 () {60 vars in 1155 bytes} [Tue Jun 28 12:11:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 28 12:11:41.939489 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ccae6fea-7091-476e-868b-1886fabc810b tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Action: 'create', calling method: .version_select at 0x7f3932c159d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1804190046", "metadata": {"Type": "work"}}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ccae6fea-7091-476e-868b-1886fabc810b tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Request method failure captured: Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 119 Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu_98GC-ojY-0iW0Z_HF_JPARo-eLVlblyLGcelyM_BRWA-2DBlSqXTY2H-mu_e-hmQWROJs5Bf-SMbakwjPax2ERwcRXYz0YH-gVrkK4UkEpV8WO5EPq4Fi3rojewcNu_T8dSJp-slgATcnDEewTSea7WIHp5HXEOp684OoJaiFsqM Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:11:41.941837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}] Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: ecb66837ff6d450d8eb7f95d1e4bff32 Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1804190046", "metadata": {"Type": "work"}}} Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: Jun 28 12:11:41.943406 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1804190046', 'metadata': {'Type': 'work'}}}} Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise error Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi '' Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:41.944232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 28 12:11:41.945564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 28 12:11:41.946970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 28 12:11:41.946970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.946970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ccae6fea-7091-476e-868b-1886fabc810b tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:41.946970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ccae6fea-7091-476e-868b-1886fabc810b tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007748 Jun 28 12:11:41.946970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 374/725] 10.222.0.55 () {60 vars in 1155 bytes} [Tue Jun 28 12:11:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 28 12:11:41.954356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b26d8fbe-790e-4ace-9e0e-341efc788eb8 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Calling method '.version_select at 0x7f3932a48820>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:41.984500 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-b26d8fbe-790e-4ace-9e0e-341efc788eb8 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] HTTP exception thrown: Volume tempest-invalid-506043316 could not be found. Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b26d8fbe-790e-4ace-9e0e-341efc788eb8 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Request method failure captured: Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-506043316 HTTP/1.1 Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu_98GC-ojY-0iW0Z_HF_JPARo-eLVlblyLGcelyM_BRWA-2DBlSqXTY2H-mu_e-hmQWROJs5Bf-SMbakwjPax2ERwcRXYz0YH-gVrkK4UkEpV8WO5EPq4Fi3rojewcNu_T8dSJp-slgATcnDEewTSea7WIHp5HXEOp684OoJaiFsqM Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:11:41.986676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}] Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: ecb66837ff6d450d8eb7f95d1e4bff32 Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Volume tempest-invalid-506043316 could not be found. Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'tempest-invalid-506043316'} Jun 28 12:11:41.988186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-506043316 could not be found. (HTTP 404) (Request-ID: req-ee5af74a-0941-49e1-88e6-93abc113cddc) Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:41.991161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 12:11:41.992331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-506043316 could not be found. Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:11:41.993673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-506043316 could not be found. Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-506043316 could not be found. Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b26d8fbe-790e-4ace-9e0e-341efc788eb8 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Returning 404 to user: Volume tempest-invalid-506043316 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b26d8fbe-790e-4ace-9e0e-341efc788eb8 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-506043316" status: 404 len: 98 microversion: 2.1 time: 0.037751 Jun 28 12:11:41.995192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 352/726] 10.222.0.55 () {58 vars in 1214 bytes} [Tue Jun 28 12:11:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-506043316 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 28 12:11:41.999027 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e3065918-596b-46bd-bff5-66ff4138b9d5 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004195 Jun 28 12:11:41.999531 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 375/727] 10.222.0.55 () {58 vars in 1139 bytes} [Tue Jun 28 12:11:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 28 12:11:42.008269 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f8b568a5-6962-46f8-85d4-aa7bf458e0dc tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003867 Jun 28 12:11:42.008785 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 353/728] 10.222.0.55 () {58 vars in 1136 bytes} [Tue Jun 28 12:11:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 28 12:11:42.018218 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-77d6b989-787c-4909-8d91-bf0a100b7e35 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Calling method '.version_select at 0x7f3932c15280>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:42.051008 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-77d6b989-787c-4909-8d91-bf0a100b7e35 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] HTTP exception thrown: Volume cc2d7ae2-2957-45c5-9299-fe9b39494a63 could not be found. Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-77d6b989-787c-4909-8d91-bf0a100b7e35 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Request method failure captured: Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/os-volumes/cc2d7ae2-2957-45c5-9299-fe9b39494a63 HTTP/1.1 Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu_98GC-ojY-0iW0Z_HF_JPARo-eLVlblyLGcelyM_BRWA-2DBlSqXTY2H-mu_e-hmQWROJs5Bf-SMbakwjPax2ERwcRXYz0YH-gVrkK4UkEpV8WO5EPq4Fi3rojewcNu_T8dSJp-slgATcnDEewTSea7WIHp5HXEOp684OoJaiFsqM Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:11:42.052986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}] Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: ecb66837ff6d450d8eb7f95d1e4bff32 Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Volume cc2d7ae2-2957-45c5-9299-fe9b39494a63 could not be found. Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': 'cc2d7ae2-2957-45c5-9299-fe9b39494a63'} Jun 28 12:11:42.054582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cc2d7ae2-2957-45c5-9299-fe9b39494a63 could not be found. (HTTP 404) (Request-ID: req-d954e0e7-88d9-48f1-a0ae-b571a95c78b5) Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:42.060271 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 12:11:42.061793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cc2d7ae2-2957-45c5-9299-fe9b39494a63 could not be found. Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 28 12:11:42.063135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cc2d7ae2-2957-45c5-9299-fe9b39494a63 could not be found. Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cc2d7ae2-2957-45c5-9299-fe9b39494a63 could not be found. Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-77d6b989-787c-4909-8d91-bf0a100b7e35 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Returning 404 to user: Volume cc2d7ae2-2957-45c5-9299-fe9b39494a63 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-77d6b989-787c-4909-8d91-bf0a100b7e35 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/cc2d7ae2-2957-45c5-9299-fe9b39494a63" status: 404 len: 109 microversion: 2.1 time: 0.040425 Jun 28 12:11:42.064513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 376/729] 10.222.0.55 () {58 vars in 1247 bytes} [Tue Jun 28 12:11:42 2022] DELETE /compute/v2.1/os-volumes/cc2d7ae2-2957-45c5-9299-fe9b39494a63 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:11:42.065567 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a0ca0a5-b4b8-4a57-a7c0-d86f8f5a7434 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Calling method '.version_select at 0x7f3932c219d0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:42.093760 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-4a0ca0a5-b4b8-4a57-a7c0-d86f8f5a7434 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] HTTP exception thrown: Volume 578491b1-e6f7-415a-ad9c-86af7c11efd6 could not be found. Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a0ca0a5-b4b8-4a57-a7c0-d86f8f5a7434 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Request method failure captured: Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/os-volumes/578491b1-e6f7-415a-ad9c-86af7c11efd6 HTTP/1.1 Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu_98GC-ojY-0iW0Z_HF_JPARo-eLVlblyLGcelyM_BRWA-2DBlSqXTY2H-mu_e-hmQWROJs5Bf-SMbakwjPax2ERwcRXYz0YH-gVrkK4UkEpV8WO5EPq4Fi3rojewcNu_T8dSJp-slgATcnDEewTSea7WIHp5HXEOp684OoJaiFsqM Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:11:42.095769 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_96a57587a6d74100bf830d9fa3807df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/96a57587a6d74100bf830d9fa3807df1"}]}] Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 96a57587a6d74100bf830d9fa3807df1 Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-2090631122 Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: ecb66837ff6d450d8eb7f95d1e4bff32 Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-2090631122-project Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Volume 578491b1-e6f7-415a-ad9c-86af7c11efd6 could not be found. Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '578491b1-e6f7-415a-ad9c-86af7c11efd6'} Jun 28 12:11:42.097359 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 578491b1-e6f7-415a-ad9c-86af7c11efd6 could not be found. (HTTP 404) (Request-ID: req-af8c1358-f054-4e19-929b-20fd69e92b78) Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:42.100725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 12:11:42.102187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 578491b1-e6f7-415a-ad9c-86af7c11efd6 could not be found. Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 12:11:42.103566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 578491b1-e6f7-415a-ad9c-86af7c11efd6 could not be found. Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 578491b1-e6f7-415a-ad9c-86af7c11efd6 could not be found. Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a0ca0a5-b4b8-4a57-a7c0-d86f8f5a7434 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] Returning 404 to user: Volume 578491b1-e6f7-415a-ad9c-86af7c11efd6 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4a0ca0a5-b4b8-4a57-a7c0-d86f8f5a7434 tempest-VolumesNegativeTest-2090631122 tempest-VolumesNegativeTest-2090631122-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/578491b1-e6f7-415a-ad9c-86af7c11efd6" status: 404 len: 109 microversion: 2.1 time: 0.036542 Jun 28 12:11:42.104944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 354/730] 10.222.0.55 () {58 vars in 1244 bytes} [Tue Jun 28 12:11:42 2022] GET /compute/v2.1/os-volumes/578491b1-e6f7-415a-ad9c-86af7c11efd6 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 12:11:42.175964 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fb0783c5-3670-4bfa-94fb-a7acb7e58706 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:42.176695 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fb0783c5-3670-4bfa-94fb-a7acb7e58706 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:42.184893 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fb0783c5-3670-4bfa-94fb-a7acb7e58706 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:42.185398 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fb0783c5-3670-4bfa-94fb-a7acb7e58706 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:42.186521 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fb0783c5-3670-4bfa-94fb-a7acb7e58706 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:42.186987 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fb0783c5-3670-4bfa-94fb-a7acb7e58706 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:42.205847 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-fb0783c5-3670-4bfa-94fb-a7acb7e58706 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] HTTP exception thrown: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fb0783c5-3670-4bfa-94fb-a7acb7e58706 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Request method failure captured: Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de HTTP/1.1 Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5WBVl25gC-2Te4R1WPROBRk_Ii8KNQDjsDx91jHO6ZWma02ekChdDed564Egd7I_j9lLDzxcblpCXdQ-Gw7e3BEdLvofFszBr-z1Eq0EhMFuVepdZfmw6gPNEUrqq8ykrgiL3anCcG6djN7zK-sMEJEEk7FCAm5IyCv_JcBurYZx8 Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:11:42.207507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}] Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: b8d8d0c23f744a7b9ad311581f6ae39f Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:11:42.209245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': 'ed81e0c7-a44e-497b-bf2e-cf208dd340de'} Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:11:42.210957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:11:42.212573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:11:42.213979 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fb0783c5-3670-4bfa-94fb-a7acb7e58706 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Returning 404 to user: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:11:42.213979 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fb0783c5-3670-4bfa-94fb-a7acb7e58706 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 404 len: 111 microversion: 2.1 time: 0.039024 Jun 28 12:11:42.216873 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 377/731] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:42 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:11:42.221805 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-96f277b3-e23f-4100-bcc7-ece762aaba4b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '.version_select at 0x7f3932ca2f70>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:42.242303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-96f277b3-e23f-4100-bcc7-ece762aaba4b tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-870893037" status: 202 len: 0 microversion: 2.1 time: 0.025120 Jun 28 12:11:42.242877 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 355/732] 10.222.0.55 () {58 vars in 1217 bytes} [Tue Jun 28 12:11:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-870893037 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 12:11:42.952396 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9fc4c67e-3598-479c-9850-78abd727bdb3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Action: 'create', calling method: .version_select at 0x7f3932c15700>, body: {"keypair": {"name": "tempest-keypair-343074167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8QFiVfpAtOXmA0jEmXQ1tf5m7sljm4e0jfRfR5I5oSJsNU0b76+Sw6sSX4xBiyIBRqGoZeM5iskXceomfGArqHFZhvW8aPnUOF0GZP1LP4VXDUnAqZ0LXglRVYusaU3Q=="}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:42.968830 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-9fc4c67e-3598-479c-9850-78abd727bdb3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Getting quotas for project 73679a9c1e1140dab3237b74ff50d3c8. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:11:42.972700 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-9fc4c67e-3598-479c-9850-78abd727bdb3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Getting quotas for user b8d8d0c23f744a7b9ad311581f6ae39f and project 73679a9c1e1140dab3237b74ff50d3c8. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:11:42.996399 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9fc4c67e-3598-479c-9850-78abd727bdb3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048348 Jun 28 12:11:42.997178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 378/733] 10.222.0.55 () {60 vars in 1158 bytes} [Tue Jun 28 12:11:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:44.495021 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1516033605", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e8b44d5-6b8c-4229-8616-a6790fa7caa6"}], "security_groups": [{"name": "tempest-securitygroup--1950784349"}], "key_name": "tempest-keypair-343074167", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:44.619254 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] validate_networks() for [('5e8b44d5-6b8c-4229-8616-a6790fa7caa6', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:11:45.135039 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:11:45.135459 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:11:45.135920 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:11:45.136557 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:11:45.137303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:11:45.142242 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:45.149321 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:45.150120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:45.150921 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:45.151354 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:45.170179 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Getting quotas for project 73679a9c1e1140dab3237b74ff50d3c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:11:45.174513 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Getting quotas for user b8d8d0c23f744a7b9ad311581f6ae39f and project 73679a9c1e1140dab3237b74ff50d3c8. Resources: {'cores', 'ram', 'instances'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:11:45.188448 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:11:45.190873 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:11:45.240042 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c27aeb34-4799-4f66-8075-95feb4b180f3 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.749890 Jun 28 12:11:45.245567 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 356/734] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:11:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:11:45.253939 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bcc9d66f-6134-48b1-bb83-13b269444eb5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:45.254610 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bcc9d66f-6134-48b1-bb83-13b269444eb5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:45.341428 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bcc9d66f-6134-48b1-bb83-13b269444eb5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:45.349204 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bcc9d66f-6134-48b1-bb83-13b269444eb5 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1237 microversion: 2.1 time: 0.101915 Jun 28 12:11:45.349780 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 379/735] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:45 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:11:46.367744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-595f365c-9bb6-4410-8381-4f43142bcd4f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:46.369340 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-595f365c-9bb6-4410-8381-4f43142bcd4f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:46.381150 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-595f365c-9bb6-4410-8381-4f43142bcd4f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:46.382056 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-595f365c-9bb6-4410-8381-4f43142bcd4f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:46.383380 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-595f365c-9bb6-4410-8381-4f43142bcd4f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:46.384294 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-595f365c-9bb6-4410-8381-4f43142bcd4f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:46.582608 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-595f365c-9bb6-4410-8381-4f43142bcd4f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:46.590701 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-595f365c-9bb6-4410-8381-4f43142bcd4f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1307 microversion: 2.1 time: 0.228424 Jun 28 12:11:46.591314 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 357/736] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:46 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:47.609311 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f9533587-0e77-49ca-9a87-803bca6495aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:47.609930 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f9533587-0e77-49ca-9a87-803bca6495aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:47.616304 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:47.617924 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9533587-0e77-49ca-9a87-803bca6495aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:47.618412 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9533587-0e77-49ca-9a87-803bca6495aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:47.619508 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9533587-0e77-49ca-9a87-803bca6495aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:47.620010 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9533587-0e77-49ca-9a87-803bca6495aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:47.900440 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f9533587-0e77-49ca-9a87-803bca6495aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:47.908225 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f9533587-0e77-49ca-9a87-803bca6495aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1363 microversion: 2.1 time: 0.304462 Jun 28 12:11:47.908792 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 380/737] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:47 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:48.183763 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-b8bbbbca-1088-4d81-9cb5-e52bbad5730c req-2d32d616-a6c2-4d45-a39f-bf6d1eae955c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0ce26f4-7e77-4c12-a6b2-2136cbde62f0", "tag": "1d1376e8-5fa7-4892-8dbf-b575fdecaa09"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:48.201900 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b8bbbbca-1088-4d81-9cb5-e52bbad5730c req-2d32d616-a6c2-4d45-a39f-bf6d1eae955c service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:48.204356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b8bbbbca-1088-4d81-9cb5-e52bbad5730c req-2d32d616-a6c2-4d45-a39f-bf6d1eae955c service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:48.220577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-b8bbbbca-1088-4d81-9cb5-e52bbad5730c req-2d32d616-a6c2-4d45-a39f-bf6d1eae955c service nova] Creating event network-changed:1d1376e8-5fa7-4892-8dbf-b575fdecaa09 for instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 on hv-cinder-84795 Jun 28 12:11:48.226219 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-b8bbbbca-1088-4d81-9cb5-e52bbad5730c req-2d32d616-a6c2-4d45-a39f-bf6d1eae955c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046348 Jun 28 12:11:48.227579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 358/738] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:48.925226 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9c27b885-af94-4c2f-9983-6b9b72312011 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:48.925941 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9c27b885-af94-4c2f-9983-6b9b72312011 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:48.932891 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c27b885-af94-4c2f-9983-6b9b72312011 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:48.933368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c27b885-af94-4c2f-9983-6b9b72312011 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:48.934103 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c27b885-af94-4c2f-9983-6b9b72312011 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:48.934494 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c27b885-af94-4c2f-9983-6b9b72312011 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:49.075520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9c27b885-af94-4c2f-9983-6b9b72312011 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:49.083139 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9c27b885-af94-4c2f-9983-6b9b72312011 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1363 microversion: 2.1 time: 0.161733 Jun 28 12:11:49.083706 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 381/739] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:48 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:50.100600 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b2e2976e-1d00-42ad-b29a-638e50717a23 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:50.101453 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b2e2976e-1d00-42ad-b29a-638e50717a23 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:50.110156 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2e2976e-1d00-42ad-b29a-638e50717a23 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:50.110602 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2e2976e-1d00-42ad-b29a-638e50717a23 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:50.111554 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2e2976e-1d00-42ad-b29a-638e50717a23 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:50.112040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2e2976e-1d00-42ad-b29a-638e50717a23 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:50.250473 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b2e2976e-1d00-42ad-b29a-638e50717a23 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:50.259659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b2e2976e-1d00-42ad-b29a-638e50717a23 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1363 microversion: 2.1 time: 0.163168 Jun 28 12:11:50.260569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 359/740] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:50 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:51.286174 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f9dd3ad6-c8b1-4a2b-8f83-0bb5ec76fe89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:51.286174 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f9dd3ad6-c8b1-4a2b-8f83-0bb5ec76fe89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:51.292057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9dd3ad6-c8b1-4a2b-8f83-0bb5ec76fe89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:51.292896 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9dd3ad6-c8b1-4a2b-8f83-0bb5ec76fe89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:51.293664 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9dd3ad6-c8b1-4a2b-8f83-0bb5ec76fe89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:51.294226 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9dd3ad6-c8b1-4a2b-8f83-0bb5ec76fe89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:51.301444 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=83 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:51.479622 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f9dd3ad6-c8b1-4a2b-8f83-0bb5ec76fe89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:51.492584 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f9dd3ad6-c8b1-4a2b-8f83-0bb5ec76fe89 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1363 microversion: 2.1 time: 0.212906 Jun 28 12:11:51.493558 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 382/741] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:51 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:52.511290 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-73b17ef1-57aa-4017-9119-a2890517ffeb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:52.511874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-73b17ef1-57aa-4017-9119-a2890517ffeb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:52.518563 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73b17ef1-57aa-4017-9119-a2890517ffeb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:52.518983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73b17ef1-57aa-4017-9119-a2890517ffeb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:52.519960 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73b17ef1-57aa-4017-9119-a2890517ffeb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:52.520412 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73b17ef1-57aa-4017-9119-a2890517ffeb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:52.671821 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-73b17ef1-57aa-4017-9119-a2890517ffeb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:52.679762 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-73b17ef1-57aa-4017-9119-a2890517ffeb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1363 microversion: 2.1 time: 0.172339 Jun 28 12:11:52.680327 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 360/742] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:52 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:53.118344 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-70cc6a0d-ecae-4fc3-b07b-c856a73a1838 req-78b14081-18c0-4c0d-8239-19d6afa4353b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ce26f4-7e77-4c12-a6b2-2136cbde62f0", "name": "network-vif-plugged", "status": "completed", "tag": "1d1376e8-5fa7-4892-8dbf-b575fdecaa09"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:53.127754 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-70cc6a0d-ecae-4fc3-b07b-c856a73a1838 req-78b14081-18c0-4c0d-8239-19d6afa4353b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:53.128228 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-70cc6a0d-ecae-4fc3-b07b-c856a73a1838 req-78b14081-18c0-4c0d-8239-19d6afa4353b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:53.140931 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-70cc6a0d-ecae-4fc3-b07b-c856a73a1838 req-78b14081-18c0-4c0d-8239-19d6afa4353b service nova] Creating event network-vif-plugged:1d1376e8-5fa7-4892-8dbf-b575fdecaa09 for instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 on hv-cinder-84795 Jun 28 12:11:53.146393 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-70cc6a0d-ecae-4fc3-b07b-c856a73a1838 req-78b14081-18c0-4c0d-8239-19d6afa4353b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031810 Jun 28 12:11:53.147114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 383/743] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:53.701784 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cfe1548b-0165-494a-bca6-ea3fd399a675 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:53.702781 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cfe1548b-0165-494a-bca6-ea3fd399a675 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:53.714334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cfe1548b-0165-494a-bca6-ea3fd399a675 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:53.715088 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cfe1548b-0165-494a-bca6-ea3fd399a675 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:53.716364 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cfe1548b-0165-494a-bca6-ea3fd399a675 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:53.717255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cfe1548b-0165-494a-bca6-ea3fd399a675 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:53.850025 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cfe1548b-0165-494a-bca6-ea3fd399a675 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:53.857962 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cfe1548b-0165-494a-bca6-ea3fd399a675 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1363 microversion: 2.1 time: 0.162703 Jun 28 12:11:53.858529 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 361/744] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:53 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:54.876569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0cca64ac-d3bf-48a8-8d39-3d78a30e1c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:54.877314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0cca64ac-d3bf-48a8-8d39-3d78a30e1c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:54.883718 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0cca64ac-d3bf-48a8-8d39-3d78a30e1c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:54.884208 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0cca64ac-d3bf-48a8-8d39-3d78a30e1c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:54.885167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0cca64ac-d3bf-48a8-8d39-3d78a30e1c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:54.885594 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0cca64ac-d3bf-48a8-8d39-3d78a30e1c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:55.026638 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0cca64ac-d3bf-48a8-8d39-3d78a30e1c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:55.034714 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0cca64ac-d3bf-48a8-8d39-3d78a30e1c83 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1363 microversion: 2.1 time: 0.163845 Jun 28 12:11:55.035303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 384/745] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:54 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:56.057112 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c3dc40b2-915b-46ae-9c3d-bf0938d987aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:56.058164 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c3dc40b2-915b-46ae-9c3d-bf0938d987aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:56.061902 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:56.062637 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:56.070927 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3dc40b2-915b-46ae-9c3d-bf0938d987aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:56.071628 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3dc40b2-915b-46ae-9c3d-bf0938d987aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:56.072807 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3dc40b2-915b-46ae-9c3d-bf0938d987aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:56.073417 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c3dc40b2-915b-46ae-9c3d-bf0938d987aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:56.219629 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c3dc40b2-915b-46ae-9c3d-bf0938d987aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:11:56.223099 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:56.228545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c3dc40b2-915b-46ae-9c3d-bf0938d987aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1549 microversion: 2.1 time: 0.177853 Jun 28 12:11:56.229140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 362/746] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:11:56 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:11:56.247924 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ebf81802-2b47-4495-84d5-cadf110a36a6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:11:56.248450 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ebf81802-2b47-4495-84d5-cadf110a36a6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:11:56.251412 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:56.257912 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebf81802-2b47-4495-84d5-cadf110a36a6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:56.258354 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebf81802-2b47-4495-84d5-cadf110a36a6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:56.259111 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebf81802-2b47-4495-84d5-cadf110a36a6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:56.259544 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ebf81802-2b47-4495-84d5-cadf110a36a6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:56.338379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ebf81802-2b47-4495-84d5-cadf110a36a6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096437 Jun 28 12:11:56.339180 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 385/747] 10.222.0.55 () {58 vars in 1274 bytes} [Tue Jun 28 12:11:56 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:11:57.374310 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-681dde53-4f4d-42a1-9975-b355e9ad7b76 req-2fb6e90d-bff0-4d55-9b11-e70863fe541b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0ce26f4-7e77-4c12-a6b2-2136cbde62f0", "tag": "1d1376e8-5fa7-4892-8dbf-b575fdecaa09"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:11:57.383247 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-681dde53-4f4d-42a1-9975-b355e9ad7b76 req-2fb6e90d-bff0-4d55-9b11-e70863fe541b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:11:57.383690 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-681dde53-4f4d-42a1-9975-b355e9ad7b76 req-2fb6e90d-bff0-4d55-9b11-e70863fe541b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:11:57.394794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-681dde53-4f4d-42a1-9975-b355e9ad7b76 req-2fb6e90d-bff0-4d55-9b11-e70863fe541b service nova] Creating event network-changed:1d1376e8-5fa7-4892-8dbf-b575fdecaa09 for instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 on hv-cinder-84795 Jun 28 12:11:57.399716 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-681dde53-4f4d-42a1-9975-b355e9ad7b76 req-2fb6e90d-bff0-4d55-9b11-e70863fe541b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029729 Jun 28 12:11:57.400539 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 363/748] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:12:30.833269 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=11 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:30.834546 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=17 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:30.838719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-964231377", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "networks": [{"uuid": "78e2b9df-bfb9-4d68-82c9-736e2be74e50"}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:12:30.890880 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] validate_networks() for [('78e2b9df-bfb9-4d68-82c9-736e2be74e50', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:12:31.266900 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:12:31.267353 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:12:31.267824 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:12:31.268228 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:12:31.268635 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:12:31.278266 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:31.278709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:31.279500 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:31.279961 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:31.297711 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Getting quotas for project 2ac1aab84e994f7892964ff85819002d. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:12:31.301890 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Getting quotas for user ddb9e04ba5c046398965b7e79eb3280b and project 2ac1aab84e994f7892964ff85819002d. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:12:31.313222 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:12:31.315445 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:12:31.366763 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a36ee93c-3a0f-4d67-8296-f0c15bff373f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534962 Jun 28 12:12:31.367439 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 386/749] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:12:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:12:31.375621 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:31.376365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:31.380415 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1b2f41ae-9792-431d-8491-ad0c9c13be4d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:31.381135 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1b2f41ae-9792-431d-8491-ad0c9c13be4d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:31.435704 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1b2f41ae-9792-431d-8491-ad0c9c13be4d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:31.442523 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1b2f41ae-9792-431d-8491-ad0c9c13be4d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1218 microversion: 2.1 time: 0.068586 Jun 28 12:12:31.443107 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 364/750] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:12:31 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:12:31.811905 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6176fb6f-0493-40b2-a079-c904b9220e57 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:31.812394 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6176fb6f-0493-40b2-a079-c904b9220e57 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:31.819231 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6176fb6f-0493-40b2-a079-c904b9220e57 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:31.819838 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6176fb6f-0493-40b2-a079-c904b9220e57 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:31.820601 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6176fb6f-0493-40b2-a079-c904b9220e57 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:31.821068 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6176fb6f-0493-40b2-a079-c904b9220e57 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:31.845801 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6176fb6f-0493-40b2-a079-c904b9220e57 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/ips" status: 200 len: 151 microversion: 2.20 time: 0.038343 Jun 28 12:12:31.846434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 387/751] 10.222.0.55 () {60 vars in 1288 bytes} [Tue Jun 28 12:12:31 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 12:12:32.464554 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5dbea7e1-3072-456d-a9f2-5ef01c95c60d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:32.465163 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5dbea7e1-3072-456d-a9f2-5ef01c95c60d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:32.471916 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dbea7e1-3072-456d-a9f2-5ef01c95c60d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:32.472371 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dbea7e1-3072-456d-a9f2-5ef01c95c60d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:32.473173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dbea7e1-3072-456d-a9f2-5ef01c95c60d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:32.473606 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dbea7e1-3072-456d-a9f2-5ef01c95c60d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:32.701442 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5dbea7e1-3072-456d-a9f2-5ef01c95c60d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:32.710899 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5dbea7e1-3072-456d-a9f2-5ef01c95c60d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1270 microversion: 2.1 time: 0.253612 Jun 28 12:12:32.711471 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 365/752] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:12:32 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1270 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:12:33.728523 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bfab31f6-1083-4b3d-aa5c-e785ee994725 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:33.729847 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bfab31f6-1083-4b3d-aa5c-e785ee994725 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:33.736698 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bfab31f6-1083-4b3d-aa5c-e785ee994725 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:33.737173 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bfab31f6-1083-4b3d-aa5c-e785ee994725 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:33.737931 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bfab31f6-1083-4b3d-aa5c-e785ee994725 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:33.738356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bfab31f6-1083-4b3d-aa5c-e785ee994725 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:33.945995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bfab31f6-1083-4b3d-aa5c-e785ee994725 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:33.956595 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bfab31f6-1083-4b3d-aa5c-e785ee994725 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1318 microversion: 2.1 time: 0.232001 Jun 28 12:12:33.957242 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 388/753] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:12:33 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:12:33.979857 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d8649c0b-8638-4d3e-97f8-5fceff0be593 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:12:33.980427 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d8649c0b-8638-4d3e-97f8-5fceff0be593 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:33.987656 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8649c0b-8638-4d3e-97f8-5fceff0be593 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:33.988112 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8649c0b-8638-4d3e-97f8-5fceff0be593 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:33.988881 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8649c0b-8638-4d3e-97f8-5fceff0be593 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:33.989537 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8649c0b-8638-4d3e-97f8-5fceff0be593 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:34.013299 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-d8649c0b-8638-4d3e-97f8-5fceff0be593 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lazy-loading 'flavor' on Instance uuid 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:12:34.277780 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d8649c0b-8638-4d3e-97f8-5fceff0be593 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "POST /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/action" status: 202 len: 0 microversion: 2.20 time: 0.302522 Jun 28 12:12:34.281575 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 366/754] 10.222.0.55 () {62 vars in 1318 bytes} [Tue Jun 28 12:12:33 2022] POST /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:12:34.287057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9b18c3ed-688e-4606-8a1c-ff520613a878 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:34.287661 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9b18c3ed-688e-4606-8a1c-ff520613a878 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:34.294197 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b18c3ed-688e-4606-8a1c-ff520613a878 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:34.300238 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-fb187df1-ca4e-4e99-8538-d87d25b43ca6 req-d5650d22-215f-4d0d-ba04-402741a4cfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56100537-a9ce-4800-9605-1da704b224aa", "tag": "cd10a703-a95c-490f-aef6-1e1c3e4b0536"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:12:34.300820 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b18c3ed-688e-4606-8a1c-ff520613a878 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:34.301730 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b18c3ed-688e-4606-8a1c-ff520613a878 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:34.302170 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b18c3ed-688e-4606-8a1c-ff520613a878 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:34.326391 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-fb187df1-ca4e-4e99-8538-d87d25b43ca6 req-d5650d22-215f-4d0d-ba04-402741a4cfc0 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:34.326920 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-fb187df1-ca4e-4e99-8538-d87d25b43ca6 req-d5650d22-215f-4d0d-ba04-402741a4cfc0 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:34.338848 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-fb187df1-ca4e-4e99-8538-d87d25b43ca6 req-d5650d22-215f-4d0d-ba04-402741a4cfc0 service nova] Creating event network-changed:cd10a703-a95c-490f-aef6-1e1c3e4b0536 for instance 56100537-a9ce-4800-9605-1da704b224aa on hv-cinder-84795 Jun 28 12:12:34.345384 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-fb187df1-ca4e-4e99-8538-d87d25b43ca6 req-d5650d22-215f-4d0d-ba04-402741a4cfc0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049134 Jun 28 12:12:34.346335 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 367/755] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:12:34.444999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b18c3ed-688e-4606-8a1c-ff520613a878 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:34.454582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b18c3ed-688e-4606-8a1c-ff520613a878 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:34.456087 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b18c3ed-688e-4606-8a1c-ff520613a878 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:34.457262 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9b18c3ed-688e-4606-8a1c-ff520613a878 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.174242 Jun 28 12:12:34.457793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 389/756] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:34 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:34.975823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b507e0da-c984-4fce-b0c7-214851c26ef4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:34.976529 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b507e0da-c984-4fce-b0c7-214851c26ef4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:34.983371 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b507e0da-c984-4fce-b0c7-214851c26ef4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:34.983974 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b507e0da-c984-4fce-b0c7-214851c26ef4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:34.984579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b507e0da-c984-4fce-b0c7-214851c26ef4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:34.985061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b507e0da-c984-4fce-b0c7-214851c26ef4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:35.118525 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b507e0da-c984-4fce-b0c7-214851c26ef4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:35.126487 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b507e0da-c984-4fce-b0c7-214851c26ef4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1318 microversion: 2.1 time: 0.154968 Jun 28 12:12:35.127050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 368/757] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:12:34 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:12:35.481203 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f48beedf-75f1-4a37-8b1a-a1014a377c90 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:35.482259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f48beedf-75f1-4a37-8b1a-a1014a377c90 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:35.493133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f48beedf-75f1-4a37-8b1a-a1014a377c90 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:35.493864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f48beedf-75f1-4a37-8b1a-a1014a377c90 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:35.495101 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f48beedf-75f1-4a37-8b1a-a1014a377c90 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:35.496305 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f48beedf-75f1-4a37-8b1a-a1014a377c90 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:35.652636 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f48beedf-75f1-4a37-8b1a-a1014a377c90 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:35.661487 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f48beedf-75f1-4a37-8b1a-a1014a377c90 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:35.662998 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f48beedf-75f1-4a37-8b1a-a1014a377c90 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:35.664156 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f48beedf-75f1-4a37-8b1a-a1014a377c90 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.190252 Jun 28 12:12:35.664710 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 390/758] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:35 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:36.143936 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7506f1b1-5edd-41e0-8671-2ca63dea3008 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:36.144531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7506f1b1-5edd-41e0-8671-2ca63dea3008 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:36.151507 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7506f1b1-5edd-41e0-8671-2ca63dea3008 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:36.152025 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7506f1b1-5edd-41e0-8671-2ca63dea3008 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:36.152791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7506f1b1-5edd-41e0-8671-2ca63dea3008 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:36.153286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7506f1b1-5edd-41e0-8671-2ca63dea3008 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:36.289796 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7506f1b1-5edd-41e0-8671-2ca63dea3008 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:36.301888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7506f1b1-5edd-41e0-8671-2ca63dea3008 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1318 microversion: 2.1 time: 0.161725 Jun 28 12:12:36.302717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 369/759] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:12:36 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:12:36.687856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8e24cb0d-d5e0-411e-b93b-c1beb4fc1a45 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:36.688843 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8e24cb0d-d5e0-411e-b93b-c1beb4fc1a45 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:36.699683 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e24cb0d-d5e0-411e-b93b-c1beb4fc1a45 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:36.700135 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e24cb0d-d5e0-411e-b93b-c1beb4fc1a45 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:36.700925 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e24cb0d-d5e0-411e-b93b-c1beb4fc1a45 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:36.701367 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e24cb0d-d5e0-411e-b93b-c1beb4fc1a45 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:36.836252 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8e24cb0d-d5e0-411e-b93b-c1beb4fc1a45 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:36.845198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8e24cb0d-d5e0-411e-b93b-c1beb4fc1a45 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:36.846710 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8e24cb0d-d5e0-411e-b93b-c1beb4fc1a45 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:36.847866 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8e24cb0d-d5e0-411e-b93b-c1beb4fc1a45 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.166856 Jun 28 12:12:36.848415 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 391/760] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:36 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:37.321339 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b015aabb-234a-45c7-903d-74dca623fe41 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:37.321925 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b015aabb-234a-45c7-903d-74dca623fe41 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:37.328789 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b015aabb-234a-45c7-903d-74dca623fe41 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:37.329278 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b015aabb-234a-45c7-903d-74dca623fe41 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:37.330048 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b015aabb-234a-45c7-903d-74dca623fe41 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:37.330485 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b015aabb-234a-45c7-903d-74dca623fe41 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:37.473838 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b015aabb-234a-45c7-903d-74dca623fe41 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:37.481501 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b015aabb-234a-45c7-903d-74dca623fe41 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1318 microversion: 2.1 time: 0.164138 Jun 28 12:12:37.484941 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 370/761] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:12:37 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:12:37.867676 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cac7f71a-aeb2-4891-a2dc-40b8cbf145ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:37.868263 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cac7f71a-aeb2-4891-a2dc-40b8cbf145ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:37.875057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cac7f71a-aeb2-4891-a2dc-40b8cbf145ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:37.875474 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cac7f71a-aeb2-4891-a2dc-40b8cbf145ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:37.876446 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cac7f71a-aeb2-4891-a2dc-40b8cbf145ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:37.877134 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cac7f71a-aeb2-4891-a2dc-40b8cbf145ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:38.021331 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cac7f71a-aeb2-4891-a2dc-40b8cbf145ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:38.029700 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cac7f71a-aeb2-4891-a2dc-40b8cbf145ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:38.031197 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cac7f71a-aeb2-4891-a2dc-40b8cbf145ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:38.033582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cac7f71a-aeb2-4891-a2dc-40b8cbf145ab tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.168625 Jun 28 12:12:38.033582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 392/762] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:37 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:38.498936 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3c635a5b-b76a-4cdb-ae9e-9cc7b7e278b4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:38.499566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3c635a5b-b76a-4cdb-ae9e-9cc7b7e278b4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:38.506530 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c635a5b-b76a-4cdb-ae9e-9cc7b7e278b4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:38.506977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c635a5b-b76a-4cdb-ae9e-9cc7b7e278b4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:38.507746 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c635a5b-b76a-4cdb-ae9e-9cc7b7e278b4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:38.508181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c635a5b-b76a-4cdb-ae9e-9cc7b7e278b4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:38.650253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3c635a5b-b76a-4cdb-ae9e-9cc7b7e278b4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:38.661789 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3c635a5b-b76a-4cdb-ae9e-9cc7b7e278b4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1318 microversion: 2.1 time: 0.166544 Jun 28 12:12:38.662663 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 371/763] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:12:38 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:12:39.055597 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8ce68dee-ebb2-4bb3-bd7a-e7d1c0791230 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:39.056432 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8ce68dee-ebb2-4bb3-bd7a-e7d1c0791230 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:39.064324 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8ce68dee-ebb2-4bb3-bd7a-e7d1c0791230 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:39.064777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8ce68dee-ebb2-4bb3-bd7a-e7d1c0791230 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:39.065575 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8ce68dee-ebb2-4bb3-bd7a-e7d1c0791230 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:39.066008 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8ce68dee-ebb2-4bb3-bd7a-e7d1c0791230 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:39.210698 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8ce68dee-ebb2-4bb3-bd7a-e7d1c0791230 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:39.219035 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8ce68dee-ebb2-4bb3-bd7a-e7d1c0791230 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:39.220533 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8ce68dee-ebb2-4bb3-bd7a-e7d1c0791230 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:39.221754 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8ce68dee-ebb2-4bb3-bd7a-e7d1c0791230 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.172982 Jun 28 12:12:39.222442 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 393/764] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:39 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:39.342452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-44eb487b-20b3-4713-b130-b618bf25a343 req-508c2e48-1532-4800-8128-2eba671f3433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56100537-a9ce-4800-9605-1da704b224aa", "name": "network-vif-plugged", "status": "completed", "tag": "cd10a703-a95c-490f-aef6-1e1c3e4b0536"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:12:39.351267 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-44eb487b-20b3-4713-b130-b618bf25a343 req-508c2e48-1532-4800-8128-2eba671f3433 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:39.351691 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-44eb487b-20b3-4713-b130-b618bf25a343 req-508c2e48-1532-4800-8128-2eba671f3433 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:39.364196 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-44eb487b-20b3-4713-b130-b618bf25a343 req-508c2e48-1532-4800-8128-2eba671f3433 service nova] Creating event network-vif-plugged:cd10a703-a95c-490f-aef6-1e1c3e4b0536 for instance 56100537-a9ce-4800-9605-1da704b224aa on hv-cinder-84795 Jun 28 12:12:39.369161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-44eb487b-20b3-4713-b130-b618bf25a343 req-508c2e48-1532-4800-8128-2eba671f3433 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030468 Jun 28 12:12:39.369892 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 372/765] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:12:39.681436 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9cf8631c-5d11-42ed-9770-7586093ee06d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:39.682083 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9cf8631c-5d11-42ed-9770-7586093ee06d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:39.688578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9cf8631c-5d11-42ed-9770-7586093ee06d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:39.689055 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9cf8631c-5d11-42ed-9770-7586093ee06d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:39.689818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9cf8631c-5d11-42ed-9770-7586093ee06d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:39.690255 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9cf8631c-5d11-42ed-9770-7586093ee06d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:39.838901 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9cf8631c-5d11-42ed-9770-7586093ee06d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:39.846763 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9cf8631c-5d11-42ed-9770-7586093ee06d tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1318 microversion: 2.1 time: 0.169197 Jun 28 12:12:39.847303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 394/766] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:12:39 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:12:40.245033 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c5c086b8-7329-43a7-befc-da070e11cccd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:40.246128 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c5c086b8-7329-43a7-befc-da070e11cccd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:40.257762 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5c086b8-7329-43a7-befc-da070e11cccd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:40.258555 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5c086b8-7329-43a7-befc-da070e11cccd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:40.259874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5c086b8-7329-43a7-befc-da070e11cccd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:40.260608 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c5c086b8-7329-43a7-befc-da070e11cccd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:40.392635 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c5c086b8-7329-43a7-befc-da070e11cccd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:40.401054 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c5c086b8-7329-43a7-befc-da070e11cccd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:40.402603 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c5c086b8-7329-43a7-befc-da070e11cccd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:40.403830 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c5c086b8-7329-43a7-befc-da070e11cccd tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.166060 Jun 28 12:12:40.404381 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 373/767] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:40 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:40.874133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7b07d901-d8af-41a9-b806-d23afa275423 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:40.875908 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7b07d901-d8af-41a9-b806-d23afa275423 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:40.890014 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b07d901-d8af-41a9-b806-d23afa275423 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:40.890832 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b07d901-d8af-41a9-b806-d23afa275423 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:40.892348 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b07d901-d8af-41a9-b806-d23afa275423 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:40.893126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7b07d901-d8af-41a9-b806-d23afa275423 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:41.040190 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7b07d901-d8af-41a9-b806-d23afa275423 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:41.050181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7b07d901-d8af-41a9-b806-d23afa275423 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1318 microversion: 2.1 time: 0.188362 Jun 28 12:12:41.050825 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 395/768] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:12:40 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:12:41.427045 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9a806615-5cdd-4105-9024-adb24d0b2ba2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:41.427909 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9a806615-5cdd-4105-9024-adb24d0b2ba2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:41.437335 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a806615-5cdd-4105-9024-adb24d0b2ba2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:41.437794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a806615-5cdd-4105-9024-adb24d0b2ba2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:41.438626 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a806615-5cdd-4105-9024-adb24d0b2ba2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:41.439070 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a806615-5cdd-4105-9024-adb24d0b2ba2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:41.439619 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:41.584711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9a806615-5cdd-4105-9024-adb24d0b2ba2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:41.593298 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9a806615-5cdd-4105-9024-adb24d0b2ba2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:41.594812 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9a806615-5cdd-4105-9024-adb24d0b2ba2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:41.595992 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9a806615-5cdd-4105-9024-adb24d0b2ba2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.176115 Jun 28 12:12:41.596568 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 374/769] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:41 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:42.068055 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-11c5cfca-35d7-4001-ac30-bb4c6b392d26 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:42.068704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-11c5cfca-35d7-4001-ac30-bb4c6b392d26 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:42.070682 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:42.071384 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:42.078407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11c5cfca-35d7-4001-ac30-bb4c6b392d26 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:42.078897 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11c5cfca-35d7-4001-ac30-bb4c6b392d26 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:42.079675 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11c5cfca-35d7-4001-ac30-bb4c6b392d26 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:42.080132 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-11c5cfca-35d7-4001-ac30-bb4c6b392d26 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:42.210435 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-11c5cfca-35d7-4001-ac30-bb4c6b392d26 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:42.218590 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-11c5cfca-35d7-4001-ac30-bb4c6b392d26 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1508 microversion: 2.1 time: 0.154619 Jun 28 12:12:42.219130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 396/770] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:12:42 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:12:42.613842 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eae8c297-b459-47f6-a876-1077ff506da2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:42.614662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eae8c297-b459-47f6-a876-1077ff506da2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:42.621363 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eae8c297-b459-47f6-a876-1077ff506da2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:42.621881 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eae8c297-b459-47f6-a876-1077ff506da2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:42.622755 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eae8c297-b459-47f6-a876-1077ff506da2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:42.623247 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eae8c297-b459-47f6-a876-1077ff506da2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:42.755608 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eae8c297-b459-47f6-a876-1077ff506da2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:42.767073 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eae8c297-b459-47f6-a876-1077ff506da2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:42.768579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eae8c297-b459-47f6-a876-1077ff506da2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:42.769797 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eae8c297-b459-47f6-a876-1077ff506da2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.160133 Jun 28 12:12:42.770456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 375/771] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:42 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:43.790285 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c0095da1-2a1c-4d86-9ace-5c20ea56df9e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:43.790927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c0095da1-2a1c-4d86-9ace-5c20ea56df9e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:43.798155 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0095da1-2a1c-4d86-9ace-5c20ea56df9e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:43.798542 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0095da1-2a1c-4d86-9ace-5c20ea56df9e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:43.799314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0095da1-2a1c-4d86-9ace-5c20ea56df9e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:43.799770 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0095da1-2a1c-4d86-9ace-5c20ea56df9e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:43.944719 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c0095da1-2a1c-4d86-9ace-5c20ea56df9e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:43.952995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c0095da1-2a1c-4d86-9ace-5c20ea56df9e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:43.954484 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c0095da1-2a1c-4d86-9ace-5c20ea56df9e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:43.955634 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c0095da1-2a1c-4d86-9ace-5c20ea56df9e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.169432 Jun 28 12:12:43.956189 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 397/772] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:43 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:44.975446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-173f3d95-cc2d-4882-820b-982653e28c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:44.976140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-173f3d95-cc2d-4882-820b-982653e28c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:44.983908 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-173f3d95-cc2d-4882-820b-982653e28c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:44.984460 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-173f3d95-cc2d-4882-820b-982653e28c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:44.985375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-173f3d95-cc2d-4882-820b-982653e28c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:44.985877 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-173f3d95-cc2d-4882-820b-982653e28c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:45.131130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-173f3d95-cc2d-4882-820b-982653e28c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:45.139585 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-173f3d95-cc2d-4882-820b-982653e28c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:45.141122 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-173f3d95-cc2d-4882-820b-982653e28c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:45.142307 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-173f3d95-cc2d-4882-820b-982653e28c70 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.171430 Jun 28 12:12:45.142890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 376/773] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:44 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:46.161880 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9524edc6-bc1f-473f-ad1a-428c2b8b2ef3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:46.162459 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9524edc6-bc1f-473f-ad1a-428c2b8b2ef3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:46.169409 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9524edc6-bc1f-473f-ad1a-428c2b8b2ef3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:46.169859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9524edc6-bc1f-473f-ad1a-428c2b8b2ef3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:46.170622 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9524edc6-bc1f-473f-ad1a-428c2b8b2ef3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:46.171058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9524edc6-bc1f-473f-ad1a-428c2b8b2ef3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:46.313900 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9524edc6-bc1f-473f-ad1a-428c2b8b2ef3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:46.322899 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9524edc6-bc1f-473f-ad1a-428c2b8b2ef3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:46.324382 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9524edc6-bc1f-473f-ad1a-428c2b8b2ef3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:46.325564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9524edc6-bc1f-473f-ad1a-428c2b8b2ef3 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1743 microversion: 2.20 time: 0.167978 Jun 28 12:12:46.326119 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 398/774] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:46 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:47.344819 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d06e2e74-a79f-47d3-b76d-4308021e718e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:47.346107 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d06e2e74-a79f-47d3-b76d-4308021e718e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:47.352700 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d06e2e74-a79f-47d3-b76d-4308021e718e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:47.353191 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d06e2e74-a79f-47d3-b76d-4308021e718e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:47.353973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d06e2e74-a79f-47d3-b76d-4308021e718e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:47.354433 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d06e2e74-a79f-47d3-b76d-4308021e718e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:47.490095 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d06e2e74-a79f-47d3-b76d-4308021e718e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:47.498273 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d06e2e74-a79f-47d3-b76d-4308021e718e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:47.500120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d06e2e74-a79f-47d3-b76d-4308021e718e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:47.501408 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d06e2e74-a79f-47d3-b76d-4308021e718e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1743 microversion: 2.20 time: 0.160640 Jun 28 12:12:47.502216 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 377/775] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:47 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:48.520281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9e22916a-d946-4286-808b-d5f4a02db9c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:48.520919 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9e22916a-d946-4286-808b-d5f4a02db9c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:48.527684 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9e22916a-d946-4286-808b-d5f4a02db9c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:48.528168 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9e22916a-d946-4286-808b-d5f4a02db9c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:48.528935 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9e22916a-d946-4286-808b-d5f4a02db9c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:48.529452 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9e22916a-d946-4286-808b-d5f4a02db9c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:48.667418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9e22916a-d946-4286-808b-d5f4a02db9c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:48.675729 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9e22916a-d946-4286-808b-d5f4a02db9c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:48.677465 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9e22916a-d946-4286-808b-d5f4a02db9c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:48.678661 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9e22916a-d946-4286-808b-d5f4a02db9c5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1743 microversion: 2.20 time: 0.162693 Jun 28 12:12:48.679224 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 399/776] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:48 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:49.571750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-b7c3ea97-182a-47be-94c5-48700b0c275f req-0a08c548-1e6d-444e-91e0-0da3c76ae252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905", "name": "network-vif-plugged", "status": "completed", "tag": "0facb1bd-c05b-4bcb-b042-f7de35787204"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:12:49.581382 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b7c3ea97-182a-47be-94c5-48700b0c275f req-0a08c548-1e6d-444e-91e0-0da3c76ae252 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:49.581786 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b7c3ea97-182a-47be-94c5-48700b0c275f req-0a08c548-1e6d-444e-91e0-0da3c76ae252 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:49.597403 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-b7c3ea97-182a-47be-94c5-48700b0c275f req-0a08c548-1e6d-444e-91e0-0da3c76ae252 service nova] Creating event network-vif-plugged:0facb1bd-c05b-4bcb-b042-f7de35787204 for instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 on hv-cinder-84795 Jun 28 12:12:49.602764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-b7c3ea97-182a-47be-94c5-48700b0c275f req-0a08c548-1e6d-444e-91e0-0da3c76ae252 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034833 Jun 28 12:12:49.603410 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 378/777] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:12:49.697662 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-55d4833b-63c4-4274-adf7-2807e2c24d7d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:49.698229 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-55d4833b-63c4-4274-adf7-2807e2c24d7d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:49.705107 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-55d4833b-63c4-4274-adf7-2807e2c24d7d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:49.705544 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-55d4833b-63c4-4274-adf7-2807e2c24d7d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:49.706286 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-55d4833b-63c4-4274-adf7-2807e2c24d7d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:49.706708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-55d4833b-63c4-4274-adf7-2807e2c24d7d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:49.858767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-55d4833b-63c4-4274-adf7-2807e2c24d7d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:49.867648 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-55d4833b-63c4-4274-adf7-2807e2c24d7d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:49.869191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-55d4833b-63c4-4274-adf7-2807e2c24d7d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:49.870382 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-55d4833b-63c4-4274-adf7-2807e2c24d7d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1743 microversion: 2.20 time: 0.176798 Jun 28 12:12:49.870935 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 400/778] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:49 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:50.892995 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7e8aa015-8939-4052-a569-30933cec4476 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:50.893738 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7e8aa015-8939-4052-a569-30933cec4476 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:50.900859 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7e8aa015-8939-4052-a569-30933cec4476 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:50.901331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7e8aa015-8939-4052-a569-30933cec4476 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:50.902080 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7e8aa015-8939-4052-a569-30933cec4476 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:50.902511 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7e8aa015-8939-4052-a569-30933cec4476 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:51.044841 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7e8aa015-8939-4052-a569-30933cec4476 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:51.054875 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7e8aa015-8939-4052-a569-30933cec4476 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:51.056396 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7e8aa015-8939-4052-a569-30933cec4476 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:51.057601 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7e8aa015-8939-4052-a569-30933cec4476 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1743 microversion: 2.20 time: 0.170494 Jun 28 12:12:51.058172 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 379/779] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:50 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:52.077811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-71bd4e7b-c61a-4e05-96bc-d38b5b41c36a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:52.078399 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-71bd4e7b-c61a-4e05-96bc-d38b5b41c36a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:52.086661 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-71bd4e7b-c61a-4e05-96bc-d38b5b41c36a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:52.087105 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-71bd4e7b-c61a-4e05-96bc-d38b5b41c36a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:52.087875 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-71bd4e7b-c61a-4e05-96bc-d38b5b41c36a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:52.088301 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-71bd4e7b-c61a-4e05-96bc-d38b5b41c36a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:52.252572 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-71bd4e7b-c61a-4e05-96bc-d38b5b41c36a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:52.261722 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-71bd4e7b-c61a-4e05-96bc-d38b5b41c36a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:52.263987 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-71bd4e7b-c61a-4e05-96bc-d38b5b41c36a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:52.265579 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-71bd4e7b-c61a-4e05-96bc-d38b5b41c36a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1743 microversion: 2.20 time: 0.191396 Jun 28 12:12:52.266369 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 401/780] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:52 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:53.290891 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9d8df88a-8755-461f-8917-f34e123d61a9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:53.290891 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9d8df88a-8755-461f-8917-f34e123d61a9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:53.297600 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d8df88a-8755-461f-8917-f34e123d61a9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:53.298056 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d8df88a-8755-461f-8917-f34e123d61a9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:53.298834 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d8df88a-8755-461f-8917-f34e123d61a9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:53.299282 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d8df88a-8755-461f-8917-f34e123d61a9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:53.435480 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d8df88a-8755-461f-8917-f34e123d61a9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:53.443398 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d8df88a-8755-461f-8917-f34e123d61a9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:53.444876 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d8df88a-8755-461f-8917-f34e123d61a9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:53.446313 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9d8df88a-8755-461f-8917-f34e123d61a9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.160263 Jun 28 12:12:53.446984 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 380/781] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:53 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:54.465041 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d4ad1abb-8b9e-4b5e-8918-5e52fd2a60e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:54.466689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d4ad1abb-8b9e-4b5e-8918-5e52fd2a60e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:54.473649 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4ad1abb-8b9e-4b5e-8918-5e52fd2a60e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:54.474357 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4ad1abb-8b9e-4b5e-8918-5e52fd2a60e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:54.475134 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4ad1abb-8b9e-4b5e-8918-5e52fd2a60e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:54.475561 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4ad1abb-8b9e-4b5e-8918-5e52fd2a60e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:54.623367 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d4ad1abb-8b9e-4b5e-8918-5e52fd2a60e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:54.633434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d4ad1abb-8b9e-4b5e-8918-5e52fd2a60e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:54.636076 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d4ad1abb-8b9e-4b5e-8918-5e52fd2a60e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:54.637643 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d4ad1abb-8b9e-4b5e-8918-5e52fd2a60e7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.176856 Jun 28 12:12:54.640938 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 402/782] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:54 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:55.656366 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-57433957-3182-4220-b301-813374484059 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:55.657665 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-57433957-3182-4220-b301-813374484059 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:55.665064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57433957-3182-4220-b301-813374484059 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:55.665911 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57433957-3182-4220-b301-813374484059 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:55.666455 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57433957-3182-4220-b301-813374484059 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:55.666895 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57433957-3182-4220-b301-813374484059 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:55.686439 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:55.818058 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-57433957-3182-4220-b301-813374484059 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:55.827155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-57433957-3182-4220-b301-813374484059 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:55.828670 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-57433957-3182-4220-b301-813374484059 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:55.830002 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-57433957-3182-4220-b301-813374484059 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.177585 Jun 28 12:12:55.830547 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 381/783] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:55 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:56.849274 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-053be2d1-2f95-4768-83f9-708b460856cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:56.849863 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-053be2d1-2f95-4768-83f9-708b460856cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:56.857416 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-053be2d1-2f95-4768-83f9-708b460856cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:56.858057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-053be2d1-2f95-4768-83f9-708b460856cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:56.859110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-053be2d1-2f95-4768-83f9-708b460856cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:56.859529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-053be2d1-2f95-4768-83f9-708b460856cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:56.878610 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:56.997613 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-053be2d1-2f95-4768-83f9-708b460856cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:57.006004 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-053be2d1-2f95-4768-83f9-708b460856cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:57.007726 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-053be2d1-2f95-4768-83f9-708b460856cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:57.009150 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-053be2d1-2f95-4768-83f9-708b460856cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.163672 Jun 28 12:12:57.010764 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 403/784] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:56 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:58.028605 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-671e5fa8-9e31-4878-b63d-634983fe5215 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:58.029238 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-671e5fa8-9e31-4878-b63d-634983fe5215 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:58.035807 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-671e5fa8-9e31-4878-b63d-634983fe5215 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:58.036269 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-671e5fa8-9e31-4878-b63d-634983fe5215 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:58.037078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-671e5fa8-9e31-4878-b63d-634983fe5215 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:58.037521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-671e5fa8-9e31-4878-b63d-634983fe5215 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:58.188935 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-671e5fa8-9e31-4878-b63d-634983fe5215 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:58.197125 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-671e5fa8-9e31-4878-b63d-634983fe5215 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:58.198934 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-671e5fa8-9e31-4878-b63d-634983fe5215 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:58.200127 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-671e5fa8-9e31-4878-b63d-634983fe5215 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.176190 Jun 28 12:12:58.200658 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 382/785] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:58 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:12:59.219581 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-aa1a6916-0ecf-4b24-9a3b-f24639755c1c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:12:59.220236 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-aa1a6916-0ecf-4b24-9a3b-f24639755c1c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:12:59.227431 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aa1a6916-0ecf-4b24-9a3b-f24639755c1c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:59.227884 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aa1a6916-0ecf-4b24-9a3b-f24639755c1c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:59.228648 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aa1a6916-0ecf-4b24-9a3b-f24639755c1c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:12:59.229121 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aa1a6916-0ecf-4b24-9a3b-f24639755c1c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:12:59.367052 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-aa1a6916-0ecf-4b24-9a3b-f24639755c1c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:59.375319 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-aa1a6916-0ecf-4b24-9a3b-f24639755c1c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:59.376810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-aa1a6916-0ecf-4b24-9a3b-f24639755c1c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:12:59.378077 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-aa1a6916-0ecf-4b24-9a3b-f24639755c1c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.162600 Jun 28 12:12:59.378718 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 404/786] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:12:59 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:00.396837 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2f8e35e4-5344-404f-b9a0-9ef567efe3c7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:00.397504 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2f8e35e4-5344-404f-b9a0-9ef567efe3c7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:00.404949 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8e35e4-5344-404f-b9a0-9ef567efe3c7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:00.405476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8e35e4-5344-404f-b9a0-9ef567efe3c7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:00.406240 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8e35e4-5344-404f-b9a0-9ef567efe3c7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:00.406675 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f8e35e4-5344-404f-b9a0-9ef567efe3c7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:00.556239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2f8e35e4-5344-404f-b9a0-9ef567efe3c7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:00.565302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2f8e35e4-5344-404f-b9a0-9ef567efe3c7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:00.567271 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2f8e35e4-5344-404f-b9a0-9ef567efe3c7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:00.568617 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2f8e35e4-5344-404f-b9a0-9ef567efe3c7 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.175736 Jun 28 12:13:00.569211 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 383/787] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:00 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:01.587726 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-52e44fcc-5f67-4165-9a2b-d0af2997c2db tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:01.588655 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-52e44fcc-5f67-4165-9a2b-d0af2997c2db tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:01.592003 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:01.596797 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-52e44fcc-5f67-4165-9a2b-d0af2997c2db tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:01.597788 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-52e44fcc-5f67-4165-9a2b-d0af2997c2db tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:01.599671 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-52e44fcc-5f67-4165-9a2b-d0af2997c2db tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:01.600327 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-52e44fcc-5f67-4165-9a2b-d0af2997c2db tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:01.753264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-52e44fcc-5f67-4165-9a2b-d0af2997c2db tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:01.761581 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-52e44fcc-5f67-4165-9a2b-d0af2997c2db tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:01.763201 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-52e44fcc-5f67-4165-9a2b-d0af2997c2db tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:01.764371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-52e44fcc-5f67-4165-9a2b-d0af2997c2db tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.181222 Jun 28 12:13:01.764944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 405/788] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:01 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:02.790783 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8ac6ac8a-7700-40d4-b009-a1f430d89294 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:02.791404 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8ac6ac8a-7700-40d4-b009-a1f430d89294 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:02.793694 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=43 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:02.800208 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ac6ac8a-7700-40d4-b009-a1f430d89294 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:02.800637 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ac6ac8a-7700-40d4-b009-a1f430d89294 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:02.801646 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ac6ac8a-7700-40d4-b009-a1f430d89294 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:02.802107 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ac6ac8a-7700-40d4-b009-a1f430d89294 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:02.979228 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8ac6ac8a-7700-40d4-b009-a1f430d89294 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:02.988759 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8ac6ac8a-7700-40d4-b009-a1f430d89294 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:02.990265 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8ac6ac8a-7700-40d4-b009-a1f430d89294 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:02.991485 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8ac6ac8a-7700-40d4-b009-a1f430d89294 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.212546 Jun 28 12:13:02.998510 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 384/789] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:02 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:04.013432 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4cc9bb95-dc39-4079-9a4a-a58d2d5507cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:04.014000 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4cc9bb95-dc39-4079-9a4a-a58d2d5507cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:04.021475 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4cc9bb95-dc39-4079-9a4a-a58d2d5507cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:04.021893 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4cc9bb95-dc39-4079-9a4a-a58d2d5507cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:04.022900 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4cc9bb95-dc39-4079-9a4a-a58d2d5507cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:04.023336 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4cc9bb95-dc39-4079-9a4a-a58d2d5507cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:04.167381 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4cc9bb95-dc39-4079-9a4a-a58d2d5507cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:04.176078 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4cc9bb95-dc39-4079-9a4a-a58d2d5507cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:04.177770 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4cc9bb95-dc39-4079-9a4a-a58d2d5507cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:04.179150 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4cc9bb95-dc39-4079-9a4a-a58d2d5507cb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.171484 Jun 28 12:13:04.179944 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 406/790] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:04 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:05.197826 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c0861331-69b4-45f8-9fef-9e3550da319c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:05.199119 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c0861331-69b4-45f8-9fef-9e3550da319c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:05.205585 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0861331-69b4-45f8-9fef-9e3550da319c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:05.206040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0861331-69b4-45f8-9fef-9e3550da319c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:05.206807 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0861331-69b4-45f8-9fef-9e3550da319c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:05.207248 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0861331-69b4-45f8-9fef-9e3550da319c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:05.365617 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c0861331-69b4-45f8-9fef-9e3550da319c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:05.376372 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c0861331-69b4-45f8-9fef-9e3550da319c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:05.378186 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c0861331-69b4-45f8-9fef-9e3550da319c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:05.379405 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c0861331-69b4-45f8-9fef-9e3550da319c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.186204 Jun 28 12:13:05.379950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 385/791] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:05 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:05.886902 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9de84d28-176e-412e-9590-fe6344641015 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d4a35ae-940c-4c76-9545-20f2f0a60abc", "device": "/dev/sdb"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:13:05.888593 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9de84d28-176e-412e-9590-fe6344641015 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:05.895258 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9de84d28-176e-412e-9590-fe6344641015 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:05.895707 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9de84d28-176e-412e-9590-fe6344641015 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:05.896476 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9de84d28-176e-412e-9590-fe6344641015 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:05.896927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9de84d28-176e-412e-9590-fe6344641015 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:06.199173 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9de84d28-176e-412e-9590-fe6344641015 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "POST /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316070 Jun 28 12:13:06.200054 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 407/792] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:13:05 2022] POST /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:13:06.399316 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-971b412e-6c81-40d5-9982-21b1ac3fbc7e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:06.399926 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-971b412e-6c81-40d5-9982-21b1ac3fbc7e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:06.409031 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-971b412e-6c81-40d5-9982-21b1ac3fbc7e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:06.409485 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-971b412e-6c81-40d5-9982-21b1ac3fbc7e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:06.410543 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-971b412e-6c81-40d5-9982-21b1ac3fbc7e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:06.410992 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-971b412e-6c81-40d5-9982-21b1ac3fbc7e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:06.551356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-971b412e-6c81-40d5-9982-21b1ac3fbc7e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:06.560244 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-971b412e-6c81-40d5-9982-21b1ac3fbc7e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:06.562404 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-971b412e-6c81-40d5-9982-21b1ac3fbc7e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:06.563896 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-971b412e-6c81-40d5-9982-21b1ac3fbc7e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.169225 Jun 28 12:13:06.564458 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 386/793] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:06 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:07.585133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-07eb407c-d2bc-4b2b-8c0b-2ce0422ad971 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:07.585920 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-07eb407c-d2bc-4b2b-8c0b-2ce0422ad971 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:07.594640 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-07eb407c-d2bc-4b2b-8c0b-2ce0422ad971 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:07.595084 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-07eb407c-d2bc-4b2b-8c0b-2ce0422ad971 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:07.595844 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-07eb407c-d2bc-4b2b-8c0b-2ce0422ad971 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:07.596275 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-07eb407c-d2bc-4b2b-8c0b-2ce0422ad971 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:07.744623 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-07eb407c-d2bc-4b2b-8c0b-2ce0422ad971 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:07.753459 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-07eb407c-d2bc-4b2b-8c0b-2ce0422ad971 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:07.754957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-07eb407c-d2bc-4b2b-8c0b-2ce0422ad971 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:07.756119 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-07eb407c-d2bc-4b2b-8c0b-2ce0422ad971 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1738 microversion: 2.20 time: 0.176977 Jun 28 12:13:07.756674 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 408/794] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:07 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:08.779213 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-96e81be7-2652-41d5-b32c-9cb44207dc27 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:08.780238 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-96e81be7-2652-41d5-b32c-9cb44207dc27 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:08.787650 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-96e81be7-2652-41d5-b32c-9cb44207dc27 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:08.788106 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-96e81be7-2652-41d5-b32c-9cb44207dc27 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:08.788890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-96e81be7-2652-41d5-b32c-9cb44207dc27 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:08.789363 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-96e81be7-2652-41d5-b32c-9cb44207dc27 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:08.924597 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-96e81be7-2652-41d5-b32c-9cb44207dc27 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:08.932703 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-96e81be7-2652-41d5-b32c-9cb44207dc27 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:08.934394 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-96e81be7-2652-41d5-b32c-9cb44207dc27 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:08.935568 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-96e81be7-2652-41d5-b32c-9cb44207dc27 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1720 microversion: 2.20 time: 0.163089 Jun 28 12:13:08.936114 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 387/795] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:08 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:09.965269 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5380a8ce-b262-452e-b320-eb6836015331 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:09.966308 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5380a8ce-b262-452e-b320-eb6836015331 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:09.974195 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5380a8ce-b262-452e-b320-eb6836015331 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:09.974643 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5380a8ce-b262-452e-b320-eb6836015331 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:09.975434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5380a8ce-b262-452e-b320-eb6836015331 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:09.975870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5380a8ce-b262-452e-b320-eb6836015331 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:10.130881 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5380a8ce-b262-452e-b320-eb6836015331 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:10.139409 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5380a8ce-b262-452e-b320-eb6836015331 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:10.141685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5380a8ce-b262-452e-b320-eb6836015331 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:10.142862 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5380a8ce-b262-452e-b320-eb6836015331 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1720 microversion: 2.20 time: 0.184708 Jun 28 12:13:10.143402 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 409/796] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:09 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:11.166416 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2682ccc0-3571-4b48-8f42-ea43027bcff9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:11.167278 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2682ccc0-3571-4b48-8f42-ea43027bcff9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:11.176204 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2682ccc0-3571-4b48-8f42-ea43027bcff9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:11.176664 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2682ccc0-3571-4b48-8f42-ea43027bcff9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:11.177467 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2682ccc0-3571-4b48-8f42-ea43027bcff9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:11.177907 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2682ccc0-3571-4b48-8f42-ea43027bcff9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:11.312962 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2682ccc0-3571-4b48-8f42-ea43027bcff9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:11.321492 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2682ccc0-3571-4b48-8f42-ea43027bcff9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:11.322978 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2682ccc0-3571-4b48-8f42-ea43027bcff9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:11.324145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2682ccc0-3571-4b48-8f42-ea43027bcff9 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1663 microversion: 2.20 time: 0.164511 Jun 28 12:13:11.324675 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 388/797] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:11 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:11.348262 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6af8f604-4583-451b-a074-a57f4152bac5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "460e94e9-aa15-477f-b4ce-cc366ff70f02"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:13:11.349439 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6af8f604-4583-451b-a074-a57f4152bac5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:11.356289 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6af8f604-4583-451b-a074-a57f4152bac5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:11.356740 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6af8f604-4583-451b-a074-a57f4152bac5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:11.357535 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6af8f604-4583-451b-a074-a57f4152bac5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:11.357972 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6af8f604-4583-451b-a074-a57f4152bac5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:11.540952 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-f9abcf66-bd86-4360-a480-3a8aeb4d6eff req-de400a78-714f-46cd-9291-bea57ebe27df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905", "name": "network-vif-unplugged", "status": "completed", "tag": "0facb1bd-c05b-4bcb-b042-f7de35787204"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:13:11.558445 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f9abcf66-bd86-4360-a480-3a8aeb4d6eff req-de400a78-714f-46cd-9291-bea57ebe27df service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:11.558876 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f9abcf66-bd86-4360-a480-3a8aeb4d6eff req-de400a78-714f-46cd-9291-bea57ebe27df service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:11.577561 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.compute.server_external_events [req-f9abcf66-bd86-4360-a480-3a8aeb4d6eff req-de400a78-714f-46cd-9291-bea57ebe27df service nova] Unable to find a host for instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905. Dropping event network-vif-unplugged {{(pid=117889) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 28 12:13:11.578521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-f9abcf66-bd86-4360-a480-3a8aeb4d6eff req-de400a78-714f-46cd-9291-bea57ebe27df service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042236 Jun 28 12:13:11.579223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 389/798] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 28 12:13:11.676945 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6af8f604-4583-451b-a074-a57f4152bac5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "POST /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.332615 Jun 28 12:13:11.677506 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 410/799] 10.222.0.55 () {62 vars in 1363 bytes} [Tue Jun 28 12:13:11 2022] POST /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 12:13:11.794906 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-826ea8f9-ce31-4ede-8356-d85f05e15881 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:11.795402 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-826ea8f9-ce31-4ede-8356-d85f05e15881 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:11.801734 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-826ea8f9-ce31-4ede-8356-d85f05e15881 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:11.802188 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-826ea8f9-ce31-4ede-8356-d85f05e15881 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:11.802947 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-826ea8f9-ce31-4ede-8356-d85f05e15881 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:11.803409 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-826ea8f9-ce31-4ede-8356-d85f05e15881 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:12.067569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-826ea8f9-ce31-4ede-8356-d85f05e15881 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/os-volume_attachments/460e94e9-aa15-477f-b4ce-cc366ff70f02" status: 202 len: 0 microversion: 2.20 time: 0.276896 Jun 28 12:13:12.068244 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 390/800] 10.222.0.55 () {60 vars in 1456 bytes} [Tue Jun 28 12:13:11 2022] DELETE /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/os-volume_attachments/460e94e9-aa15-477f-b4ce-cc366ff70f02 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:13:12.125607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cea8a291-5b14-4e29-841d-f2fab652f047 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:13:12.126363 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cea8a291-5b14-4e29-841d-f2fab652f047 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:12.132806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cea8a291-5b14-4e29-841d-f2fab652f047 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:12.133279 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cea8a291-5b14-4e29-841d-f2fab652f047 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:12.134053 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cea8a291-5b14-4e29-841d-f2fab652f047 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:12.134480 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cea8a291-5b14-4e29-841d-f2fab652f047 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:12.239014 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cea8a291-5b14-4e29-841d-f2fab652f047 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "POST /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/action" status: 202 len: 0 microversion: 2.20 time: 0.117239 Jun 28 12:13:12.239579 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 411/801] 10.222.0.55 () {62 vars in 1318 bytes} [Tue Jun 28 12:13:12 2022] POST /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:13:12.247759 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-58dce79e-a354-480c-9f94-f910cd49065f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:12.248996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-58dce79e-a354-480c-9f94-f910cd49065f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:12.258616 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58dce79e-a354-480c-9f94-f910cd49065f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:12.259137 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58dce79e-a354-480c-9f94-f910cd49065f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:12.259905 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58dce79e-a354-480c-9f94-f910cd49065f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:12.260340 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58dce79e-a354-480c-9f94-f910cd49065f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:12.650219 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-58dce79e-a354-480c-9f94-f910cd49065f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:12.661411 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-58dce79e-a354-480c-9f94-f910cd49065f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:12.663272 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-58dce79e-a354-480c-9f94-f910cd49065f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:12.664606 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-58dce79e-a354-480c-9f94-f910cd49065f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1671 microversion: 2.20 time: 0.420803 Jun 28 12:13:12.665333 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 391/802] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:12 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1671 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:13.687628 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-25b9c142-1928-4444-a5db-bd27ef0ed13c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:13.688748 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-25b9c142-1928-4444-a5db-bd27ef0ed13c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:13.696187 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25b9c142-1928-4444-a5db-bd27ef0ed13c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:13.696709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25b9c142-1928-4444-a5db-bd27ef0ed13c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:13.697642 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25b9c142-1928-4444-a5db-bd27ef0ed13c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:13.698067 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-25b9c142-1928-4444-a5db-bd27ef0ed13c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:13.908479 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-25b9c142-1928-4444-a5db-bd27ef0ed13c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:13.917760 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-25b9c142-1928-4444-a5db-bd27ef0ed13c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:13.919752 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-25b9c142-1928-4444-a5db-bd27ef0ed13c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:13.921050 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-25b9c142-1928-4444-a5db-bd27ef0ed13c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.240780 Jun 28 12:13:13.933065 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 412/803] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:13 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:14.940813 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c4ff318a-d15b-4c8f-91fe-f15e8689ad50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:14.941411 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c4ff318a-d15b-4c8f-91fe-f15e8689ad50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:14.948089 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4ff318a-d15b-4c8f-91fe-f15e8689ad50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:14.948541 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4ff318a-d15b-4c8f-91fe-f15e8689ad50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:14.949324 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4ff318a-d15b-4c8f-91fe-f15e8689ad50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:14.949757 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4ff318a-d15b-4c8f-91fe-f15e8689ad50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:15.087240 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4ff318a-d15b-4c8f-91fe-f15e8689ad50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:15.095489 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4ff318a-d15b-4c8f-91fe-f15e8689ad50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:15.097044 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4ff318a-d15b-4c8f-91fe-f15e8689ad50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:15.098229 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c4ff318a-d15b-4c8f-91fe-f15e8689ad50 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.162254 Jun 28 12:13:15.098785 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 392/804] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:14 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:16.116481 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-73fc5089-3c48-422e-beb3-35a82c34c8b1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:16.117070 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-73fc5089-3c48-422e-beb3-35a82c34c8b1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:16.124178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-73fc5089-3c48-422e-beb3-35a82c34c8b1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:16.124620 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-73fc5089-3c48-422e-beb3-35a82c34c8b1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:16.125401 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-73fc5089-3c48-422e-beb3-35a82c34c8b1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:16.125830 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-73fc5089-3c48-422e-beb3-35a82c34c8b1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:16.274757 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-73fc5089-3c48-422e-beb3-35a82c34c8b1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:16.283576 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-73fc5089-3c48-422e-beb3-35a82c34c8b1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:16.285098 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-73fc5089-3c48-422e-beb3-35a82c34c8b1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:16.286248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-73fc5089-3c48-422e-beb3-35a82c34c8b1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.173735 Jun 28 12:13:16.286806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 413/805] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:16 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:17.304221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0ef6db9d-f003-4049-9f9b-0b3b370690c2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:17.305499 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0ef6db9d-f003-4049-9f9b-0b3b370690c2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:17.312506 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ef6db9d-f003-4049-9f9b-0b3b370690c2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:17.312895 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ef6db9d-f003-4049-9f9b-0b3b370690c2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:17.313960 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ef6db9d-f003-4049-9f9b-0b3b370690c2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:17.314258 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ef6db9d-f003-4049-9f9b-0b3b370690c2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:17.469492 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0ef6db9d-f003-4049-9f9b-0b3b370690c2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:17.478049 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0ef6db9d-f003-4049-9f9b-0b3b370690c2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:17.479561 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0ef6db9d-f003-4049-9f9b-0b3b370690c2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:17.480742 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0ef6db9d-f003-4049-9f9b-0b3b370690c2 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.180633 Jun 28 12:13:17.481328 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 393/806] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:17 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:18.502819 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a5ce4276-387f-4d52-97c3-6f0794fbdbe5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:18.504060 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a5ce4276-387f-4d52-97c3-6f0794fbdbe5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:18.514562 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5ce4276-387f-4d52-97c3-6f0794fbdbe5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:18.515209 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5ce4276-387f-4d52-97c3-6f0794fbdbe5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:18.516330 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5ce4276-387f-4d52-97c3-6f0794fbdbe5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:18.517104 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5ce4276-387f-4d52-97c3-6f0794fbdbe5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:18.659485 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a5ce4276-387f-4d52-97c3-6f0794fbdbe5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:18.667735 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a5ce4276-387f-4d52-97c3-6f0794fbdbe5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:18.669256 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a5ce4276-387f-4d52-97c3-6f0794fbdbe5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:18.670417 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a5ce4276-387f-4d52-97c3-6f0794fbdbe5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.173896 Jun 28 12:13:18.671026 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 414/807] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:18 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:19.690230 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0720aac8-74cf-4f01-8e7f-3f768dfe0872 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:19.690872 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0720aac8-74cf-4f01-8e7f-3f768dfe0872 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:19.698062 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0720aac8-74cf-4f01-8e7f-3f768dfe0872 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:19.698523 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0720aac8-74cf-4f01-8e7f-3f768dfe0872 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:19.699285 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0720aac8-74cf-4f01-8e7f-3f768dfe0872 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:19.699744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0720aac8-74cf-4f01-8e7f-3f768dfe0872 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:19.836576 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0720aac8-74cf-4f01-8e7f-3f768dfe0872 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:19.845611 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0720aac8-74cf-4f01-8e7f-3f768dfe0872 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:19.847389 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0720aac8-74cf-4f01-8e7f-3f768dfe0872 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:19.848671 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0720aac8-74cf-4f01-8e7f-3f768dfe0872 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.162595 Jun 28 12:13:19.849343 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 394/808] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:19 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:20.868350 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f1f5cdd6-d9f7-4b0b-8c39-468631ce4c63 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:20.868990 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f1f5cdd6-d9f7-4b0b-8c39-468631ce4c63 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:20.875902 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1f5cdd6-d9f7-4b0b-8c39-468631ce4c63 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:20.876350 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1f5cdd6-d9f7-4b0b-8c39-468631ce4c63 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:20.877164 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1f5cdd6-d9f7-4b0b-8c39-468631ce4c63 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:20.877574 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1f5cdd6-d9f7-4b0b-8c39-468631ce4c63 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:20.881691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:21.013228 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f1f5cdd6-d9f7-4b0b-8c39-468631ce4c63 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:21.022623 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f1f5cdd6-d9f7-4b0b-8c39-468631ce4c63 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:21.024507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f1f5cdd6-d9f7-4b0b-8c39-468631ce4c63 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:21.025397 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f1f5cdd6-d9f7-4b0b-8c39-468631ce4c63 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.161239 Jun 28 12:13:21.025937 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 415/809] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:20 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:22.044142 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e6b51c4d-1678-45f2-b3a1-05540e0e0d11 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:22.044702 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e6b51c4d-1678-45f2-b3a1-05540e0e0d11 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:22.053229 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6b51c4d-1678-45f2-b3a1-05540e0e0d11 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:22.053673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6b51c4d-1678-45f2-b3a1-05540e0e0d11 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:22.054432 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6b51c4d-1678-45f2-b3a1-05540e0e0d11 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:22.054866 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6b51c4d-1678-45f2-b3a1-05540e0e0d11 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:22.194266 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6b51c4d-1678-45f2-b3a1-05540e0e0d11 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:22.202260 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6b51c4d-1678-45f2-b3a1-05540e0e0d11 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:22.203746 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6b51c4d-1678-45f2-b3a1-05540e0e0d11 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:22.205645 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e6b51c4d-1678-45f2-b3a1-05540e0e0d11 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.165628 Jun 28 12:13:22.206224 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 395/810] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:22 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:23.224647 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9fe3f934-4b48-48ef-b291-53c6dbf5ce0a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:23.225359 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9fe3f934-4b48-48ef-b291-53c6dbf5ce0a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:23.232465 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fe3f934-4b48-48ef-b291-53c6dbf5ce0a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:23.232939 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fe3f934-4b48-48ef-b291-53c6dbf5ce0a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:23.233698 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fe3f934-4b48-48ef-b291-53c6dbf5ce0a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:23.234124 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9fe3f934-4b48-48ef-b291-53c6dbf5ce0a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:23.372452 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9fe3f934-4b48-48ef-b291-53c6dbf5ce0a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:23.382712 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9fe3f934-4b48-48ef-b291-53c6dbf5ce0a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:23.384200 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9fe3f934-4b48-48ef-b291-53c6dbf5ce0a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:23.385385 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9fe3f934-4b48-48ef-b291-53c6dbf5ce0a tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.164794 Jun 28 12:13:23.385918 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 416/811] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:23 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:24.021898 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb2487fa-f96c-462d-8b8e-262427be2c85 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:24.023230 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cb2487fa-f96c-462d-8b8e-262427be2c85 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:24.030569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb2487fa-f96c-462d-8b8e-262427be2c85 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:24.031024 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb2487fa-f96c-462d-8b8e-262427be2c85 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:24.031903 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb2487fa-f96c-462d-8b8e-262427be2c85 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:24.032420 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb2487fa-f96c-462d-8b8e-262427be2c85 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:24.047621 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:24.059352 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cb2487fa-f96c-462d-8b8e-262427be2c85 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/ips" status: 200 len: 145 microversion: 2.1 time: 0.041515 Jun 28 12:13:24.059907 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 396/812] 10.222.0.55 () {58 vars in 1247 bytes} [Tue Jun 28 12:13:24 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:13:24.403767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7dd0a9f0-842d-452d-800b-b67402f29263 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:24.404468 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7dd0a9f0-842d-452d-800b-b67402f29263 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:24.412176 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dd0a9f0-842d-452d-800b-b67402f29263 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:24.412728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dd0a9f0-842d-452d-800b-b67402f29263 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:24.413717 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dd0a9f0-842d-452d-800b-b67402f29263 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:24.414148 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7dd0a9f0-842d-452d-800b-b67402f29263 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:24.557651 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7dd0a9f0-842d-452d-800b-b67402f29263 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:24.568736 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7dd0a9f0-842d-452d-800b-b67402f29263 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:24.570644 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7dd0a9f0-842d-452d-800b-b67402f29263 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:24.571999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7dd0a9f0-842d-452d-800b-b67402f29263 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.172174 Jun 28 12:13:24.573217 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 417/813] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:24 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:25.593766 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f397e10b-112b-411e-89ff-12658c7290ef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:25.594396 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f397e10b-112b-411e-89ff-12658c7290ef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:25.601562 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f397e10b-112b-411e-89ff-12658c7290ef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:25.602013 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f397e10b-112b-411e-89ff-12658c7290ef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:25.602812 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f397e10b-112b-411e-89ff-12658c7290ef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:25.603252 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f397e10b-112b-411e-89ff-12658c7290ef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:25.737819 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f397e10b-112b-411e-89ff-12658c7290ef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:25.746639 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f397e10b-112b-411e-89ff-12658c7290ef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:25.748159 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f397e10b-112b-411e-89ff-12658c7290ef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:25.749409 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f397e10b-112b-411e-89ff-12658c7290ef tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.159989 Jun 28 12:13:25.749972 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 397/814] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:25 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:26.773441 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-562e129f-49cb-40c4-9be4-505d9c6e5ce8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:26.774067 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-562e129f-49cb-40c4-9be4-505d9c6e5ce8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:26.781053 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-562e129f-49cb-40c4-9be4-505d9c6e5ce8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:26.781500 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-562e129f-49cb-40c4-9be4-505d9c6e5ce8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:26.782268 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-562e129f-49cb-40c4-9be4-505d9c6e5ce8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:26.782704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-562e129f-49cb-40c4-9be4-505d9c6e5ce8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:26.920411 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-562e129f-49cb-40c4-9be4-505d9c6e5ce8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:26.933861 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-562e129f-49cb-40c4-9be4-505d9c6e5ce8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:26.936284 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-562e129f-49cb-40c4-9be4-505d9c6e5ce8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:26.938150 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-562e129f-49cb-40c4-9be4-505d9c6e5ce8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.168564 Jun 28 12:13:26.938996 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 418/815] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:26 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:27.959096 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-17835504-03b6-46ac-ac04-97be3b6e5faf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:27.959723 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-17835504-03b6-46ac-ac04-97be3b6e5faf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:27.966455 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17835504-03b6-46ac-ac04-97be3b6e5faf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:27.966980 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17835504-03b6-46ac-ac04-97be3b6e5faf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:27.967997 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17835504-03b6-46ac-ac04-97be3b6e5faf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:27.968444 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17835504-03b6-46ac-ac04-97be3b6e5faf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:28.115760 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-17835504-03b6-46ac-ac04-97be3b6e5faf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:28.123782 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-17835504-03b6-46ac-ac04-97be3b6e5faf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:28.125323 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-17835504-03b6-46ac-ac04-97be3b6e5faf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:28.126498 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-17835504-03b6-46ac-ac04-97be3b6e5faf tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.172060 Jun 28 12:13:28.127049 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 398/816] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:27 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:29.145746 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-aa300fcc-189a-41e3-b31d-054fc0b11046 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:29.146339 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-aa300fcc-189a-41e3-b31d-054fc0b11046 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:29.153446 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aa300fcc-189a-41e3-b31d-054fc0b11046 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:29.154235 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aa300fcc-189a-41e3-b31d-054fc0b11046 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:29.155214 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aa300fcc-189a-41e3-b31d-054fc0b11046 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:29.155852 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aa300fcc-189a-41e3-b31d-054fc0b11046 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:29.294339 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-aa300fcc-189a-41e3-b31d-054fc0b11046 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:29.302988 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-aa300fcc-189a-41e3-b31d-054fc0b11046 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:29.304510 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-aa300fcc-189a-41e3-b31d-054fc0b11046 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:29.305691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-aa300fcc-189a-41e3-b31d-054fc0b11046 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.164504 Jun 28 12:13:29.306243 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 419/817] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:29 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:30.327690 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d3c94c61-bca8-4987-b84a-c69881e013c0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:30.328706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d3c94c61-bca8-4987-b84a-c69881e013c0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:30.337651 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d3c94c61-bca8-4987-b84a-c69881e013c0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:30.338114 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d3c94c61-bca8-4987-b84a-c69881e013c0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:30.338890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d3c94c61-bca8-4987-b84a-c69881e013c0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:30.339335 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d3c94c61-bca8-4987-b84a-c69881e013c0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:30.473638 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d3c94c61-bca8-4987-b84a-c69881e013c0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:30.486386 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d3c94c61-bca8-4987-b84a-c69881e013c0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:30.488869 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d3c94c61-bca8-4987-b84a-c69881e013c0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:30.490086 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d3c94c61-bca8-4987-b84a-c69881e013c0 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.169023 Jun 28 12:13:30.490660 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 399/818] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:30 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:31.512557 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-853b0e65-cb75-4cb0-aaac-552d36e572fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:31.513608 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-853b0e65-cb75-4cb0-aaac-552d36e572fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:31.524856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-853b0e65-cb75-4cb0-aaac-552d36e572fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:31.525669 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-853b0e65-cb75-4cb0-aaac-552d36e572fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:31.526926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-853b0e65-cb75-4cb0-aaac-552d36e572fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:31.527648 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-853b0e65-cb75-4cb0-aaac-552d36e572fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:31.668688 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-853b0e65-cb75-4cb0-aaac-552d36e572fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:31.680687 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-853b0e65-cb75-4cb0-aaac-552d36e572fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:31.683018 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-853b0e65-cb75-4cb0-aaac-552d36e572fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:31.684729 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-853b0e65-cb75-4cb0-aaac-552d36e572fc tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.178563 Jun 28 12:13:31.685585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 420/819] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:31 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:32.709140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f2f0fedf-517d-4b3d-a0df-62ffc5768eb6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:32.709707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f2f0fedf-517d-4b3d-a0df-62ffc5768eb6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:32.716173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2f0fedf-517d-4b3d-a0df-62ffc5768eb6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:32.716625 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2f0fedf-517d-4b3d-a0df-62ffc5768eb6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:32.717429 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2f0fedf-517d-4b3d-a0df-62ffc5768eb6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:32.717866 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f2f0fedf-517d-4b3d-a0df-62ffc5768eb6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:32.850334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f2f0fedf-517d-4b3d-a0df-62ffc5768eb6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:32.858477 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f2f0fedf-517d-4b3d-a0df-62ffc5768eb6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:32.859974 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f2f0fedf-517d-4b3d-a0df-62ffc5768eb6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:32.861176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f2f0fedf-517d-4b3d-a0df-62ffc5768eb6 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.159696 Jun 28 12:13:32.861770 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 400/820] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:32 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:33.882856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b08aec9d-16ad-41cd-a649-83384303d63d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:33.883941 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b08aec9d-16ad-41cd-a649-83384303d63d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:33.886310 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=34 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:33.893857 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b08aec9d-16ad-41cd-a649-83384303d63d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:33.894506 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b08aec9d-16ad-41cd-a649-83384303d63d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:33.895289 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b08aec9d-16ad-41cd-a649-83384303d63d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:33.895723 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b08aec9d-16ad-41cd-a649-83384303d63d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:34.040398 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b08aec9d-16ad-41cd-a649-83384303d63d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:34.048722 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b08aec9d-16ad-41cd-a649-83384303d63d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:34.050243 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b08aec9d-16ad-41cd-a649-83384303d63d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:34.051446 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b08aec9d-16ad-41cd-a649-83384303d63d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.175117 Jun 28 12:13:34.051975 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 421/821] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:33 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:35.070228 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-04874bfd-fbf2-485b-ad53-e51bd2023b5c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:35.070802 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-04874bfd-fbf2-485b-ad53-e51bd2023b5c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:35.073384 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=34 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:35.079138 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04874bfd-fbf2-485b-ad53-e51bd2023b5c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:35.079594 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04874bfd-fbf2-485b-ad53-e51bd2023b5c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:35.080365 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04874bfd-fbf2-485b-ad53-e51bd2023b5c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:35.080819 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-04874bfd-fbf2-485b-ad53-e51bd2023b5c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:35.214183 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-04874bfd-fbf2-485b-ad53-e51bd2023b5c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:35.222526 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-04874bfd-fbf2-485b-ad53-e51bd2023b5c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:35.224049 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-04874bfd-fbf2-485b-ad53-e51bd2023b5c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:35.225274 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-04874bfd-fbf2-485b-ad53-e51bd2023b5c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.158936 Jun 28 12:13:35.225841 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 401/822] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:35 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:36.247614 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a654f70b-f630-48af-8c33-f62d7ed4e1fa tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:36.248322 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a654f70b-f630-48af-8c33-f62d7ed4e1fa tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:36.257502 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a654f70b-f630-48af-8c33-f62d7ed4e1fa tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:36.258104 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a654f70b-f630-48af-8c33-f62d7ed4e1fa tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:36.259121 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a654f70b-f630-48af-8c33-f62d7ed4e1fa tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:36.259702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a654f70b-f630-48af-8c33-f62d7ed4e1fa tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:36.402030 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a654f70b-f630-48af-8c33-f62d7ed4e1fa tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:36.410347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a654f70b-f630-48af-8c33-f62d7ed4e1fa tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:36.411874 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a654f70b-f630-48af-8c33-f62d7ed4e1fa tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:36.413064 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a654f70b-f630-48af-8c33-f62d7ed4e1fa tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.171393 Jun 28 12:13:36.413631 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 422/823] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:36 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:37.436081 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-faea5a51-5335-4a89-8d26-4c9d15c5bed1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:37.436963 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-faea5a51-5335-4a89-8d26-4c9d15c5bed1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:37.447928 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-faea5a51-5335-4a89-8d26-4c9d15c5bed1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:37.448380 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-faea5a51-5335-4a89-8d26-4c9d15c5bed1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:37.449190 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-faea5a51-5335-4a89-8d26-4c9d15c5bed1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:37.449631 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-faea5a51-5335-4a89-8d26-4c9d15c5bed1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:37.595830 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-faea5a51-5335-4a89-8d26-4c9d15c5bed1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:37.604174 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-faea5a51-5335-4a89-8d26-4c9d15c5bed1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:37.605734 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-faea5a51-5335-4a89-8d26-4c9d15c5bed1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:37.606905 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-faea5a51-5335-4a89-8d26-4c9d15c5bed1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.177703 Jun 28 12:13:37.607465 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 402/824] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:37 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:38.629333 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fe33355a-886c-4cbe-beae-0eef5473576f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:38.630350 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fe33355a-886c-4cbe-beae-0eef5473576f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:38.641870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe33355a-886c-4cbe-beae-0eef5473576f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:38.642314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe33355a-886c-4cbe-beae-0eef5473576f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:38.643094 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe33355a-886c-4cbe-beae-0eef5473576f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:38.643545 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe33355a-886c-4cbe-beae-0eef5473576f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:38.786804 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fe33355a-886c-4cbe-beae-0eef5473576f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:38.795280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fe33355a-886c-4cbe-beae-0eef5473576f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:38.796797 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fe33355a-886c-4cbe-beae-0eef5473576f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:38.797988 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fe33355a-886c-4cbe-beae-0eef5473576f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.175496 Jun 28 12:13:38.798595 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 423/825] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:38 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:39.817694 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a91a7986-921d-42a7-b37c-42a963067d9f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:39.818314 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a91a7986-921d-42a7-b37c-42a963067d9f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:39.825515 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a91a7986-921d-42a7-b37c-42a963067d9f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:39.825963 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a91a7986-921d-42a7-b37c-42a963067d9f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:39.826736 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a91a7986-921d-42a7-b37c-42a963067d9f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:39.827172 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a91a7986-921d-42a7-b37c-42a963067d9f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:39.973306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a91a7986-921d-42a7-b37c-42a963067d9f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:39.981827 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a91a7986-921d-42a7-b37c-42a963067d9f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:39.983341 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a91a7986-921d-42a7-b37c-42a963067d9f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:39.984512 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a91a7986-921d-42a7-b37c-42a963067d9f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.170938 Jun 28 12:13:39.985292 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 403/826] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:39 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:40.177249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-64b66290-f5b0-433a-8997-6d86fcc0fd81 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f420fa54-c3c1-4227-969f-297580a571c7"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:13:40.178314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-64b66290-f5b0-433a-8997-6d86fcc0fd81 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:40.185284 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-64b66290-f5b0-433a-8997-6d86fcc0fd81 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:40.185726 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-64b66290-f5b0-433a-8997-6d86fcc0fd81 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:40.186473 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-64b66290-f5b0-433a-8997-6d86fcc0fd81 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:40.186915 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-64b66290-f5b0-433a-8997-6d86fcc0fd81 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:40.486490 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-64b66290-f5b0-433a-8997-6d86fcc0fd81 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "POST /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313122 Jun 28 12:13:40.487185 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 424/827] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:13:40 2022] POST /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:13:41.002552 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3615bf69-ab57-4587-a55c-00b667ae2491 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:41.003124 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3615bf69-ab57-4587-a55c-00b667ae2491 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:41.015770 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3615bf69-ab57-4587-a55c-00b667ae2491 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:41.016103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3615bf69-ab57-4587-a55c-00b667ae2491 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:41.017159 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3615bf69-ab57-4587-a55c-00b667ae2491 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:41.017595 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3615bf69-ab57-4587-a55c-00b667ae2491 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:41.155076 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3615bf69-ab57-4587-a55c-00b667ae2491 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:41.164672 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3615bf69-ab57-4587-a55c-00b667ae2491 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:41.166228 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3615bf69-ab57-4587-a55c-00b667ae2491 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:41.167406 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3615bf69-ab57-4587-a55c-00b667ae2491 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.169027 Jun 28 12:13:41.168227 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 404/828] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:40 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:42.193112 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0b8b2a3e-9a36-40ee-9b96-e948af48e619 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:42.194153 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0b8b2a3e-9a36-40ee-9b96-e948af48e619 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:42.205068 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0b8b2a3e-9a36-40ee-9b96-e948af48e619 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:42.205801 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0b8b2a3e-9a36-40ee-9b96-e948af48e619 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:42.207044 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0b8b2a3e-9a36-40ee-9b96-e948af48e619 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:42.208143 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0b8b2a3e-9a36-40ee-9b96-e948af48e619 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:42.343237 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0b8b2a3e-9a36-40ee-9b96-e948af48e619 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:42.351573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0b8b2a3e-9a36-40ee-9b96-e948af48e619 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:42.353140 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0b8b2a3e-9a36-40ee-9b96-e948af48e619 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:42.354303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0b8b2a3e-9a36-40ee-9b96-e948af48e619 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.169401 Jun 28 12:13:42.354866 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 425/829] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:42 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:42.757387 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-6bfeb087-d186-48fb-aa05-9220d1994832 req-ca86008b-88d2-4f75-af66-8e23c53ed667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905", "name": "network-vif-plugged", "status": "completed", "tag": "0facb1bd-c05b-4bcb-b042-f7de35787204"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:13:42.769573 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6bfeb087-d186-48fb-aa05-9220d1994832 req-ca86008b-88d2-4f75-af66-8e23c53ed667 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:42.770036 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6bfeb087-d186-48fb-aa05-9220d1994832 req-ca86008b-88d2-4f75-af66-8e23c53ed667 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:42.782992 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-6bfeb087-d186-48fb-aa05-9220d1994832 req-ca86008b-88d2-4f75-af66-8e23c53ed667 service nova] Creating event network-vif-plugged:0facb1bd-c05b-4bcb-b042-f7de35787204 for instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 on hv-cinder-84795 Jun 28 12:13:42.788522 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-6bfeb087-d186-48fb-aa05-9220d1994832 req-ca86008b-88d2-4f75-af66-8e23c53ed667 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034873 Jun 28 12:13:42.789344 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 405/830] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:13:43.377971 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-21677040-9a2b-46db-9440-8d4a4ec90515 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:43.378783 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-21677040-9a2b-46db-9440-8d4a4ec90515 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:43.389681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21677040-9a2b-46db-9440-8d4a4ec90515 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:43.390152 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21677040-9a2b-46db-9440-8d4a4ec90515 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:43.390894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21677040-9a2b-46db-9440-8d4a4ec90515 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:43.391324 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-21677040-9a2b-46db-9440-8d4a4ec90515 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:43.537263 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-21677040-9a2b-46db-9440-8d4a4ec90515 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:43.546024 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-21677040-9a2b-46db-9440-8d4a4ec90515 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:43.547634 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-21677040-9a2b-46db-9440-8d4a4ec90515 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:43.548859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-21677040-9a2b-46db-9440-8d4a4ec90515 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.177540 Jun 28 12:13:43.549834 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 426/831] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:43 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:44.574799 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ef313a62-a1e1-4005-a3d6-4c74dc4c562c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:44.575791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ef313a62-a1e1-4005-a3d6-4c74dc4c562c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:44.588327 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef313a62-a1e1-4005-a3d6-4c74dc4c562c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:44.588819 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef313a62-a1e1-4005-a3d6-4c74dc4c562c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:44.590313 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef313a62-a1e1-4005-a3d6-4c74dc4c562c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:44.590731 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef313a62-a1e1-4005-a3d6-4c74dc4c562c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:44.726313 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ef313a62-a1e1-4005-a3d6-4c74dc4c562c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:44.735350 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ef313a62-a1e1-4005-a3d6-4c74dc4c562c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:44.738510 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ef313a62-a1e1-4005-a3d6-4c74dc4c562c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:44.739719 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ef313a62-a1e1-4005-a3d6-4c74dc4c562c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.172756 Jun 28 12:13:44.740293 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 406/832] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:44 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:45.584051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1495125316", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1512622342", "security_groups": [{"name": "tempest-secgroup-smoke-1078744139"}], "block_device_mapping_v2": [{"uuid": "2248f393-c4c7-4d0c-80b3-7f8b5bd49e13", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "460be620-b015-4979-a780-ce463435c616"}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:13:45.700238 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] validate_networks() for [('460be620-b015-4979-a780-ce463435c616', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:13:45.758718 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2f0f61e7-7968-4224-b0f7-8645a059fd1f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:45.759317 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2f0f61e7-7968-4224-b0f7-8645a059fd1f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:45.765705 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f0f61e7-7968-4224-b0f7-8645a059fd1f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:45.766163 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f0f61e7-7968-4224-b0f7-8645a059fd1f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:45.766941 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f0f61e7-7968-4224-b0f7-8645a059fd1f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:45.767383 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2f0f61e7-7968-4224-b0f7-8645a059fd1f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:45.911434 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2f0f61e7-7968-4224-b0f7-8645a059fd1f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:45.919863 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2f0f61e7-7968-4224-b0f7-8645a059fd1f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:45.921964 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2f0f61e7-7968-4224-b0f7-8645a059fd1f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:45.923173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2f0f61e7-7968-4224-b0f7-8645a059fd1f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.168521 Jun 28 12:13:45.923711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 407/833] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:45 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:46.089214 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:13:46.089634 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:13:46.090098 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:13:46.090498 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:13:46.090897 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:13:46.100281 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:46.100717 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:46.101526 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:46.101946 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:46.119119 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Getting quotas for project 7235a9c7eff24e0e94900ec2abc92ae5. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:13:46.123724 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Getting quotas for user 9f56095d6bac4f108a73790ac9004f3b and project 7235a9c7eff24e0e94900ec2abc92ae5. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:13:46.183071 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:13:46.186294 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2248f393-c4c7-4d0c-80b3-7f8b5bd49e13',volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:13:46.331309 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5173c4b7-320a-4689-b37e-69b2480a4ada tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751549 Jun 28 12:13:46.333521 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 427/834] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:13:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:13:46.345545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-df87efa0-0cb0-4eb6-8847-199e693187d5 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:46.346265 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-df87efa0-0cb0-4eb6-8847-199e693187d5 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:46.405202 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-df87efa0-0cb0-4eb6-8847-199e693187d5 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:46.411994 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-df87efa0-0cb0-4eb6-8847-199e693187d5 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1095 microversion: 2.1 time: 0.072357 Jun 28 12:13:46.412572 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 408/835] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:46 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:46.698435 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1841438a-8a40-4864-a38f-5691cae39b6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:46.699039 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1841438a-8a40-4864-a38f-5691cae39b6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:46.708673 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1841438a-8a40-4864-a38f-5691cae39b6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:46.709235 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1841438a-8a40-4864-a38f-5691cae39b6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:46.710003 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1841438a-8a40-4864-a38f-5691cae39b6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:46.710433 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1841438a-8a40-4864-a38f-5691cae39b6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:46.803326 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-1841438a-8a40-4864-a38f-5691cae39b6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lazy-loading 'services' on Instance uuid 56100537-a9ce-4800-9605-1da704b224aa {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:13:46.886871 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1841438a-8a40-4864-a38f-5691cae39b6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "DELETE /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa/os-volume_attachments/9d4a35ae-940c-4c76-9545-20f2f0a60abc" status: 202 len: 0 microversion: 2.1 time: 0.193265 Jun 28 12:13:46.887548 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 428/836] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:13:46 2022] DELETE /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa/os-volume_attachments/9d4a35ae-940c-4c76-9545-20f2f0a60abc => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 12:13:46.942201 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-30abf194-b493-4ad8-aa75-04e2f3e8deba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:46.943061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-30abf194-b493-4ad8-aa75-04e2f3e8deba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:46.951874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30abf194-b493-4ad8-aa75-04e2f3e8deba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:46.952399 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30abf194-b493-4ad8-aa75-04e2f3e8deba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:46.953323 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30abf194-b493-4ad8-aa75-04e2f3e8deba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:46.953865 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30abf194-b493-4ad8-aa75-04e2f3e8deba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:47.096579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-30abf194-b493-4ad8-aa75-04e2f3e8deba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:47.104706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-30abf194-b493-4ad8-aa75-04e2f3e8deba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:47.106230 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-30abf194-b493-4ad8-aa75-04e2f3e8deba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:47.108086 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-30abf194-b493-4ad8-aa75-04e2f3e8deba tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1729 microversion: 2.20 time: 0.169260 Jun 28 12:13:47.108824 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 409/837] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:46 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:47.432755 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-06f875e4-f600-4976-9662-7f8613fa4708 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:47.433930 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-06f875e4-f600-4976-9662-7f8613fa4708 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:47.440852 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06f875e4-f600-4976-9662-7f8613fa4708 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:47.441331 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06f875e4-f600-4976-9662-7f8613fa4708 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:47.442105 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06f875e4-f600-4976-9662-7f8613fa4708 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:47.442533 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-06f875e4-f600-4976-9662-7f8613fa4708 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:47.533756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-06f875e4-f600-4976-9662-7f8613fa4708 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:47.541077 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-06f875e4-f600-4976-9662-7f8613fa4708 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1201 microversion: 2.1 time: 0.115309 Jun 28 12:13:47.541962 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 429/838] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:47 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1201 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:48.133842 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-edac404d-4361-41ee-bb98-3d755e62a46d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:48.134512 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-edac404d-4361-41ee-bb98-3d755e62a46d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:48.143489 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edac404d-4361-41ee-bb98-3d755e62a46d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:48.144166 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edac404d-4361-41ee-bb98-3d755e62a46d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:48.145424 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edac404d-4361-41ee-bb98-3d755e62a46d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:48.146234 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-edac404d-4361-41ee-bb98-3d755e62a46d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:48.290679 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-edac404d-4361-41ee-bb98-3d755e62a46d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:48.299402 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-edac404d-4361-41ee-bb98-3d755e62a46d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:48.301050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-edac404d-4361-41ee-bb98-3d755e62a46d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:48.302376 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-edac404d-4361-41ee-bb98-3d755e62a46d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1716 microversion: 2.20 time: 0.179301 Jun 28 12:13:48.303337 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 410/839] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:13:48 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1716 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:13:48.558998 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-83634531-db42-4a9a-ab4a-9f8314d1251c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:48.559623 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-83634531-db42-4a9a-ab4a-9f8314d1251c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:48.567680 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-83634531-db42-4a9a-ab4a-9f8314d1251c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:48.568131 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-83634531-db42-4a9a-ab4a-9f8314d1251c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:48.568926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-83634531-db42-4a9a-ab4a-9f8314d1251c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:48.569386 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-83634531-db42-4a9a-ab4a-9f8314d1251c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:48.589085 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:48.848190 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-83634531-db42-4a9a-ab4a-9f8314d1251c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:48.856059 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-83634531-db42-4a9a-ab4a-9f8314d1251c tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1279 microversion: 2.1 time: 0.301127 Jun 28 12:13:48.856636 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 430/840] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:48 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1279 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:49.255626 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-bbb198c3-e760-44f1-8e05-4f7e8b6f7c15 req-3a4c99ca-c075-4fe8-a6a9-081fd5ec6270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1cbbba-49fd-4642-850d-b38e9dd57dd1", "tag": "f866ebc7-18e6-4ceb-b17b-1bd22be179a3"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:13:49.265118 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-bbb198c3-e760-44f1-8e05-4f7e8b6f7c15 req-3a4c99ca-c075-4fe8-a6a9-081fd5ec6270 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:49.265805 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-bbb198c3-e760-44f1-8e05-4f7e8b6f7c15 req-3a4c99ca-c075-4fe8-a6a9-081fd5ec6270 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:49.279651 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-bbb198c3-e760-44f1-8e05-4f7e8b6f7c15 req-3a4c99ca-c075-4fe8-a6a9-081fd5ec6270 service nova] Creating event network-changed:f866ebc7-18e6-4ceb-b17b-1bd22be179a3 for instance ca1cbbba-49fd-4642-850d-b38e9dd57dd1 on hv-cinder-84795 Jun 28 12:13:49.284755 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-bbb198c3-e760-44f1-8e05-4f7e8b6f7c15 req-3a4c99ca-c075-4fe8-a6a9-081fd5ec6270 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032926 Jun 28 12:13:49.288441 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 411/841] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:13:49.874215 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4d927979-20cb-4343-88f6-9cc05fc2877d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:49.875063 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4d927979-20cb-4343-88f6-9cc05fc2877d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:49.882043 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d927979-20cb-4343-88f6-9cc05fc2877d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:49.882496 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d927979-20cb-4343-88f6-9cc05fc2877d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:49.883282 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d927979-20cb-4343-88f6-9cc05fc2877d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:49.883687 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4d927979-20cb-4343-88f6-9cc05fc2877d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:50.117846 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4d927979-20cb-4343-88f6-9cc05fc2877d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:50.127046 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4d927979-20cb-4343-88f6-9cc05fc2877d tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1279 microversion: 2.1 time: 0.257245 Jun 28 12:13:50.127688 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 431/842] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:49 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1279 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:51.144797 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-475a6dd1-11b5-4002-b65a-f7d8dedb899e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:51.145537 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-475a6dd1-11b5-4002-b65a-f7d8dedb899e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:51.151992 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-475a6dd1-11b5-4002-b65a-f7d8dedb899e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:51.152447 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-475a6dd1-11b5-4002-b65a-f7d8dedb899e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:51.153232 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-475a6dd1-11b5-4002-b65a-f7d8dedb899e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:51.153659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-475a6dd1-11b5-4002-b65a-f7d8dedb899e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:51.301946 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-475a6dd1-11b5-4002-b65a-f7d8dedb899e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:51.313152 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-475a6dd1-11b5-4002-b65a-f7d8dedb899e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1279 microversion: 2.1 time: 0.173206 Jun 28 12:13:51.313753 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 412/843] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:51 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1279 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:52.335791 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7d105b74-e93f-4dd9-9dbb-a7388ffacdcb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:52.336453 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7d105b74-e93f-4dd9-9dbb-a7388ffacdcb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:52.343984 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d105b74-e93f-4dd9-9dbb-a7388ffacdcb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:52.344554 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d105b74-e93f-4dd9-9dbb-a7388ffacdcb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:52.345613 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d105b74-e93f-4dd9-9dbb-a7388ffacdcb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:52.346173 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7d105b74-e93f-4dd9-9dbb-a7388ffacdcb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:52.515500 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7d105b74-e93f-4dd9-9dbb-a7388ffacdcb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:52.527488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7d105b74-e93f-4dd9-9dbb-a7388ffacdcb tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1279 microversion: 2.1 time: 0.199612 Jun 28 12:13:52.528280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 432/844] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:52 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1279 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:53.311649 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b94f48fd-a689-4f63-9a27-9e15f445c2df tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:53.312830 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b94f48fd-a689-4f63-9a27-9e15f445c2df tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:53.321826 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b94f48fd-a689-4f63-9a27-9e15f445c2df tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:53.322469 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b94f48fd-a689-4f63-9a27-9e15f445c2df tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:53.323666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b94f48fd-a689-4f63-9a27-9e15f445c2df tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:53.324481 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b94f48fd-a689-4f63-9a27-9e15f445c2df tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:53.363912 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b94f48fd-a689-4f63-9a27-9e15f445c2df tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058679 Jun 28 12:13:53.364452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 413/845] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:13:53 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:13:53.381621 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bdebbb57-7962-4a63-994b-8d7482c15ca4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:53.382834 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bdebbb57-7962-4a63-994b-8d7482c15ca4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:53.392535 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bdebbb57-7962-4a63-994b-8d7482c15ca4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:53.393024 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bdebbb57-7962-4a63-994b-8d7482c15ca4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:53.394140 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bdebbb57-7962-4a63-994b-8d7482c15ca4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:53.394696 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bdebbb57-7962-4a63-994b-8d7482c15ca4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:53.427751 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bdebbb57-7962-4a63-994b-8d7482c15ca4 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments/f420fa54-c3c1-4227-969f-297580a571c7" status: 200 len: 194 microversion: 2.1 time: 0.056357 Jun 28 12:13:53.428364 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 433/846] 10.222.0.55 () {58 vars in 1412 bytes} [Tue Jun 28 12:13:53 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments/f420fa54-c3c1-4227-969f-297580a571c7 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:13:53.547325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1eafd3e5-1e94-4a1b-9d71-792b1ee6f526 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:53.547886 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1eafd3e5-1e94-4a1b-9d71-792b1ee6f526 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:53.557344 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1eafd3e5-1e94-4a1b-9d71-792b1ee6f526 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:53.557845 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1eafd3e5-1e94-4a1b-9d71-792b1ee6f526 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:53.559865 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1eafd3e5-1e94-4a1b-9d71-792b1ee6f526 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:53.560320 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1eafd3e5-1e94-4a1b-9d71-792b1ee6f526 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:53.708322 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1eafd3e5-1e94-4a1b-9d71-792b1ee6f526 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:53.719630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1eafd3e5-1e94-4a1b-9d71-792b1ee6f526 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1279 microversion: 2.1 time: 0.176642 Jun 28 12:13:53.720269 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 414/847] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:53 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:54.365405 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e108a4a4-10ea-429d-9c03-6618f9b245de tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:54.365931 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e108a4a4-10ea-429d-9c03-6618f9b245de tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:54.372120 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e108a4a4-10ea-429d-9c03-6618f9b245de tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:54.372564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e108a4a4-10ea-429d-9c03-6618f9b245de tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:54.373607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e108a4a4-10ea-429d-9c03-6618f9b245de tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:54.374040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e108a4a4-10ea-429d-9c03-6618f9b245de tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:54.398954 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e108a4a4-10ea-429d-9c03-6618f9b245de tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:13:54.485119 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e108a4a4-10ea-429d-9c03-6618f9b245de tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "DELETE /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 204 len: 0 microversion: 2.1 time: 0.123159 Jun 28 12:13:54.485862 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 434/848] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:13:54 2022] DELETE /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:13:54.493915 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9d4d59a4-e7b6-4ae7-8db3-ae1e5b0c848c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:54.494525 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9d4d59a4-e7b6-4ae7-8db3-ae1e5b0c848c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:54.501188 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d4d59a4-e7b6-4ae7-8db3-ae1e5b0c848c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:54.501644 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d4d59a4-e7b6-4ae7-8db3-ae1e5b0c848c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:54.502405 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d4d59a4-e7b6-4ae7-8db3-ae1e5b0c848c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:54.502840 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d4d59a4-e7b6-4ae7-8db3-ae1e5b0c848c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:54.648982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d4d59a4-e7b6-4ae7-8db3-ae1e5b0c848c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:54.652436 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:54.659627 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9d4d59a4-e7b6-4ae7-8db3-ae1e5b0c848c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1514 microversion: 2.1 time: 0.169585 Jun 28 12:13:54.660213 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 415/849] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:54 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:54.737251 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fe0f9438-5546-4f9d-9dbe-7bab41c3a40e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:54.737941 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fe0f9438-5546-4f9d-9dbe-7bab41c3a40e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:54.744936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe0f9438-5546-4f9d-9dbe-7bab41c3a40e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:54.745426 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe0f9438-5546-4f9d-9dbe-7bab41c3a40e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:54.746259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe0f9438-5546-4f9d-9dbe-7bab41c3a40e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:54.746721 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fe0f9438-5546-4f9d-9dbe-7bab41c3a40e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:54.816395 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-92b82ca5-a475-4d25-b4c6-e19dd2428980 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05c775ad-45ad-4ce7-ba77-854fdce8f9b5"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:13:54.817624 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-92b82ca5-a475-4d25-b4c6-e19dd2428980 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:54.823884 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92b82ca5-a475-4d25-b4c6-e19dd2428980 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:54.824306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92b82ca5-a475-4d25-b4c6-e19dd2428980 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:54.825087 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92b82ca5-a475-4d25-b4c6-e19dd2428980 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:54.825546 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92b82ca5-a475-4d25-b4c6-e19dd2428980 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:54.883864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fe0f9438-5546-4f9d-9dbe-7bab41c3a40e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:54.891758 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fe0f9438-5546-4f9d-9dbe-7bab41c3a40e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1279 microversion: 2.1 time: 0.158831 Jun 28 12:13:54.892303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 435/850] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:54 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:55.681317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ff6a72f4-2552-450c-b8a1-a45e45b1a04b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:55.682390 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ff6a72f4-2552-450c-b8a1-a45e45b1a04b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:55.691053 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff6a72f4-2552-450c-b8a1-a45e45b1a04b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:55.691499 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff6a72f4-2552-450c-b8a1-a45e45b1a04b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:55.692249 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff6a72f4-2552-450c-b8a1-a45e45b1a04b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:55.692675 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ff6a72f4-2552-450c-b8a1-a45e45b1a04b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:55.837903 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ff6a72f4-2552-450c-b8a1-a45e45b1a04b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:55.849538 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ff6a72f4-2552-450c-b8a1-a45e45b1a04b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1514 microversion: 2.1 time: 0.174692 Jun 28 12:13:55.850284 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 436/851] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:55 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:55.908862 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f9b1d32f-fd00-4e43-8c3b-fdcf61c02322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:55.909663 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f9b1d32f-fd00-4e43-8c3b-fdcf61c02322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:55.917311 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9b1d32f-fd00-4e43-8c3b-fdcf61c02322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:55.918120 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9b1d32f-fd00-4e43-8c3b-fdcf61c02322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:55.919425 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9b1d32f-fd00-4e43-8c3b-fdcf61c02322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:55.920130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f9b1d32f-fd00-4e43-8c3b-fdcf61c02322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:56.067209 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-92b82ca5-a475-4d25-b4c6-e19dd2428980 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "POST /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254682 Jun 28 12:13:56.067845 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 416/852] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:13:54 2022] POST /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments => generated 194 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:13:56.080458 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f9b1d32f-fd00-4e43-8c3b-fdcf61c02322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:56.088452 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f9b1d32f-fd00-4e43-8c3b-fdcf61c02322 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1279 microversion: 2.1 time: 0.183893 Jun 28 12:13:56.088965 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 437/853] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:55 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1279 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:13:56.868452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:56.876154 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fb328330-cce9-417a-8606-3fbd49ebac61 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:56.877361 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fb328330-cce9-417a-8606-3fbd49ebac61 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:56.887896 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb328330-cce9-417a-8606-3fbd49ebac61 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:56.888532 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb328330-cce9-417a-8606-3fbd49ebac61 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:56.889941 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb328330-cce9-417a-8606-3fbd49ebac61 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:56.890375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb328330-cce9-417a-8606-3fbd49ebac61 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:57.053172 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fb328330-cce9-417a-8606-3fbd49ebac61 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:57.063257 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fb328330-cce9-417a-8606-3fbd49ebac61 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1514 microversion: 2.1 time: 0.197235 Jun 28 12:13:57.063825 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 417/854] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:56 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:57.104845 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-00d6448d-a72a-47fd-8888-6bac16771492 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:57.105450 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-00d6448d-a72a-47fd-8888-6bac16771492 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:57.107481 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:57.108149 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:57.117654 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00d6448d-a72a-47fd-8888-6bac16771492 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:57.118352 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00d6448d-a72a-47fd-8888-6bac16771492 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:57.119446 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00d6448d-a72a-47fd-8888-6bac16771492 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:57.120091 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-00d6448d-a72a-47fd-8888-6bac16771492 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:57.261689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-00d6448d-a72a-47fd-8888-6bac16771492 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:57.269822 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-00d6448d-a72a-47fd-8888-6bac16771492 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.168888 Jun 28 12:13:57.270393 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 438/855] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:57 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:58.013874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-60991b36-030c-4db5-9e6b-faef05a96e13 req-8c7c0842-84d2-42ef-a1ab-476ed7f9c17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56100537-a9ce-4800-9605-1da704b224aa", "name": "network-vif-deleted", "tag": "cd10a703-a95c-490f-aef6-1e1c3e4b0536"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:13:58.023048 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-60991b36-030c-4db5-9e6b-faef05a96e13 req-8c7c0842-84d2-42ef-a1ab-476ed7f9c17e service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:58.023494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-60991b36-030c-4db5-9e6b-faef05a96e13 req-8c7c0842-84d2-42ef-a1ab-476ed7f9c17e service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:58.035284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-60991b36-030c-4db5-9e6b-faef05a96e13 req-8c7c0842-84d2-42ef-a1ab-476ed7f9c17e service nova] Creating event network-vif-deleted:cd10a703-a95c-490f-aef6-1e1c3e4b0536 for instance 56100537-a9ce-4800-9605-1da704b224aa on hv-cinder-84795 Jun 28 12:13:58.040131 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-60991b36-030c-4db5-9e6b-faef05a96e13 req-8c7c0842-84d2-42ef-a1ab-476ed7f9c17e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030046 Jun 28 12:13:58.041065 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 418/856] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:13:58.079972 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7c7485ff-c0fd-4761-a3a8-56a76689396f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:58.080576 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7c7485ff-c0fd-4761-a3a8-56a76689396f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:58.087122 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c7485ff-c0fd-4761-a3a8-56a76689396f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:58.087570 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c7485ff-c0fd-4761-a3a8-56a76689396f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:58.088322 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c7485ff-c0fd-4761-a3a8-56a76689396f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:58.088768 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c7485ff-c0fd-4761-a3a8-56a76689396f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:58.153975 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7c7485ff-c0fd-4761-a3a8-56a76689396f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:58.161933 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7c7485ff-c0fd-4761-a3a8-56a76689396f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 200 len: 1303 microversion: 2.1 time: 0.085975 Jun 28 12:13:58.162921 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 439/857] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:58 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 1303 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:13:58.291463 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c293fcd3-01c2-4a78-a804-c7881fd46e9e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:58.292096 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c293fcd3-01c2-4a78-a804-c7881fd46e9e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:58.300237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c293fcd3-01c2-4a78-a804-c7881fd46e9e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:58.300691 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c293fcd3-01c2-4a78-a804-c7881fd46e9e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:58.301524 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c293fcd3-01c2-4a78-a804-c7881fd46e9e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:58.301941 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c293fcd3-01c2-4a78-a804-c7881fd46e9e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:58.442861 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c293fcd3-01c2-4a78-a804-c7881fd46e9e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:58.450482 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c293fcd3-01c2-4a78-a804-c7881fd46e9e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.166002 Jun 28 12:13:58.451111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 419/858] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:58 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:13:59.183980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7dcf397-5d8b-4491-b1c4-71336648b91f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:59.184851 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a7dcf397-5d8b-4491-b1c4-71336648b91f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 56100537-a9ce-4800-9605-1da704b224aa] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:59.196237 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7dcf397-5d8b-4491-b1c4-71336648b91f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:59.197010 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7dcf397-5d8b-4491-b1c4-71336648b91f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:59.198291 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7dcf397-5d8b-4491-b1c4-71336648b91f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:59.199007 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7dcf397-5d8b-4491-b1c4-71336648b91f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:59.214109 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-a7dcf397-5d8b-4491-b1c4-71336648b91f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] HTTP exception thrown: Instance 56100537-a9ce-4800-9605-1da704b224aa could not be found. Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7dcf397-5d8b-4491-b1c4-71336648b91f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Request method failure captured: Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa HTTP/1.1 Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuvAtbfIFxaNxZxBr4peOXVXPmUqEra7fwQmTkS1CzhGG5bB1O4kzUOHRhlhkrOmiaYa6IIp_EQugmmyS3CPq73pX4cHRX8iNRoS8lbYG5D21GxmZX2XPI8qxx8f2ozOpdWr_2FQI-qjwztRrNffKBdaItGTLcGqjkSJ5Ts6AV_Hwx0M Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 2ac1aab84e994f7892964ff85819002d Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2031561607 Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:13:59.215737 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2ac1aab84e994f7892964ff85819002d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2ac1aab84e994f7892964ff85819002d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2ac1aab84e994f7892964ff85819002d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2ac1aab84e994f7892964ff85819002d"}]}] Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-VolumesSnapshotTestJSON-2031561607 Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 2ac1aab84e994f7892964ff85819002d Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2031561607 Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-VolumesSnapshotTestJSON-2031561607-project Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: ddb9e04ba5c046398965b7e79eb3280b Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-VolumesSnapshotTestJSON-2031561607-project Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance 56100537-a9ce-4800-9605-1da704b224aa could not be found. Jun 28 12:13:59.217756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '56100537-a9ce-4800-9605-1da704b224aa'} Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56100537-a9ce-4800-9605-1da704b224aa could not be found. Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:13:59.218691 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56100537-a9ce-4800-9605-1da704b224aa could not be found. Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56100537-a9ce-4800-9605-1da704b224aa could not be found. Jun 28 12:13:59.220840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:13:59.222353 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7dcf397-5d8b-4491-b1c4-71336648b91f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Returning 404 to user: Instance 56100537-a9ce-4800-9605-1da704b224aa could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:13:59.222353 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a7dcf397-5d8b-4491-b1c4-71336648b91f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa" status: 404 len: 111 microversion: 2.1 time: 0.039931 Jun 28 12:13:59.222353 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 440/859] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:59 2022] GET /compute/v2.1/servers/56100537-a9ce-4800-9605-1da704b224aa => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:13:59.469280 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-741d6e98-ddfb-43fb-9de3-b42926b66377 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:13:59.469866 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-741d6e98-ddfb-43fb-9de3-b42926b66377 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:13:59.476654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-741d6e98-ddfb-43fb-9de3-b42926b66377 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:59.477159 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-741d6e98-ddfb-43fb-9de3-b42926b66377 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:59.477930 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-741d6e98-ddfb-43fb-9de3-b42926b66377 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:13:59.478442 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-741d6e98-ddfb-43fb-9de3-b42926b66377 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:13:59.618143 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-741d6e98-ddfb-43fb-9de3-b42926b66377 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:13:59.625829 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-741d6e98-ddfb-43fb-9de3-b42926b66377 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.161515 Jun 28 12:13:59.626405 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 420/860] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:13:59 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:00.644736 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-723fb3aa-8828-4af6-9582-094a2b6f8c08 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:00.645428 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-723fb3aa-8828-4af6-9582-094a2b6f8c08 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:00.652660 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-723fb3aa-8828-4af6-9582-094a2b6f8c08 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:00.653238 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-723fb3aa-8828-4af6-9582-094a2b6f8c08 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:00.654102 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-723fb3aa-8828-4af6-9582-094a2b6f8c08 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:00.654604 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-723fb3aa-8828-4af6-9582-094a2b6f8c08 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:00.798731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-723fb3aa-8828-4af6-9582-094a2b6f8c08 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:00.806374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-723fb3aa-8828-4af6-9582-094a2b6f8c08 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.167091 Jun 28 12:14:00.806946 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 441/861] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:00 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:01.824346 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3a5855c0-d627-4a09-8d32-3eb08c2a0381 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:01.824975 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3a5855c0-d627-4a09-8d32-3eb08c2a0381 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:01.832575 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a5855c0-d627-4a09-8d32-3eb08c2a0381 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:01.833059 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a5855c0-d627-4a09-8d32-3eb08c2a0381 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:01.833827 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a5855c0-d627-4a09-8d32-3eb08c2a0381 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:01.834272 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a5855c0-d627-4a09-8d32-3eb08c2a0381 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:01.982658 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3a5855c0-d627-4a09-8d32-3eb08c2a0381 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:01.990886 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3a5855c0-d627-4a09-8d32-3eb08c2a0381 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.170531 Jun 28 12:14:01.991456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 421/862] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:01 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:03.016082 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c5d8ee15-50c3-4a9b-852a-b4fda395606b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:03.017130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c5d8ee15-50c3-4a9b-852a-b4fda395606b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:03.028329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5d8ee15-50c3-4a9b-852a-b4fda395606b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:03.029041 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5d8ee15-50c3-4a9b-852a-b4fda395606b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:03.030542 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5d8ee15-50c3-4a9b-852a-b4fda395606b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:03.030978 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5d8ee15-50c3-4a9b-852a-b4fda395606b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:03.187159 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c5d8ee15-50c3-4a9b-852a-b4fda395606b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:03.194704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c5d8ee15-50c3-4a9b-852a-b4fda395606b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.185176 Jun 28 12:14:03.195240 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 442/863] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:03 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:04.216097 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-57104323-24c8-4c36-a61c-923113992614 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:04.217036 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-57104323-24c8-4c36-a61c-923113992614 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:04.228101 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57104323-24c8-4c36-a61c-923113992614 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:04.228858 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57104323-24c8-4c36-a61c-923113992614 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:04.230234 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57104323-24c8-4c36-a61c-923113992614 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:04.230969 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57104323-24c8-4c36-a61c-923113992614 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:04.368057 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-57104323-24c8-4c36-a61c-923113992614 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:04.379576 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-57104323-24c8-4c36-a61c-923113992614 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.169784 Jun 28 12:14:04.380364 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 422/864] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:04 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:05.404477 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-659b1400-5968-4d62-a5e4-111007846380 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:05.405971 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-659b1400-5968-4d62-a5e4-111007846380 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:05.408455 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:05.414258 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-659b1400-5968-4d62-a5e4-111007846380 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:05.414705 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-659b1400-5968-4d62-a5e4-111007846380 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:05.415471 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-659b1400-5968-4d62-a5e4-111007846380 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:05.415907 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-659b1400-5968-4d62-a5e4-111007846380 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:05.555856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-659b1400-5968-4d62-a5e4-111007846380 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:05.566485 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-659b1400-5968-4d62-a5e4-111007846380 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.168678 Jun 28 12:14:05.567148 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 443/865] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:05 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:06.586925 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1ed9d75e-868f-4654-8b41-80344f1cff61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:06.587505 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1ed9d75e-868f-4654-8b41-80344f1cff61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:06.590051 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=46 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:06.595737 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ed9d75e-868f-4654-8b41-80344f1cff61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:06.596192 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ed9d75e-868f-4654-8b41-80344f1cff61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:06.596995 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ed9d75e-868f-4654-8b41-80344f1cff61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:06.597445 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ed9d75e-868f-4654-8b41-80344f1cff61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:06.746372 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1ed9d75e-868f-4654-8b41-80344f1cff61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:06.754512 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1ed9d75e-868f-4654-8b41-80344f1cff61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.171613 Jun 28 12:14:06.755081 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 423/866] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:06 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:06.785685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f75fb299-663f-408c-91af-d63eaf8904aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:06.786732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f75fb299-663f-408c-91af-d63eaf8904aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:06.793448 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f75fb299-663f-408c-91af-d63eaf8904aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:06.793898 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f75fb299-663f-408c-91af-d63eaf8904aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:06.794672 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f75fb299-663f-408c-91af-d63eaf8904aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:06.795111 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f75fb299-663f-408c-91af-d63eaf8904aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:06.824478 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f75fb299-663f-408c-91af-d63eaf8904aa tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042793 Jun 28 12:14:06.825070 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 444/867] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:14:06 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:06.972105 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d620aed9-5676-432f-9bde-a11f198644fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:06.972489 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d620aed9-5676-432f-9bde-a11f198644fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:06.979020 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d620aed9-5676-432f-9bde-a11f198644fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:06.979475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d620aed9-5676-432f-9bde-a11f198644fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:06.980584 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d620aed9-5676-432f-9bde-a11f198644fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:06.980695 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d620aed9-5676-432f-9bde-a11f198644fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:07.010457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d620aed9-5676-432f-9bde-a11f198644fd tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments/f420fa54-c3c1-4227-969f-297580a571c7" status: 200 len: 194 microversion: 2.1 time: 0.043333 Jun 28 12:14:07.011075 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 424/868] 10.222.0.55 () {58 vars in 1412 bytes} [Tue Jun 28 12:14:06 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments/f420fa54-c3c1-4227-969f-297580a571c7 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:07.021266 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9c722198-e6b4-4c14-9bf5-4fbb6c3e5db9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:07.021757 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9c722198-e6b4-4c14-9bf5-4fbb6c3e5db9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:07.028492 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c722198-e6b4-4c14-9bf5-4fbb6c3e5db9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:07.028961 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c722198-e6b4-4c14-9bf5-4fbb6c3e5db9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:07.029729 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c722198-e6b4-4c14-9bf5-4fbb6c3e5db9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:07.030172 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c722198-e6b4-4c14-9bf5-4fbb6c3e5db9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:07.126847 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-9c722198-e6b4-4c14-9bf5-4fbb6c3e5db9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lazy-loading 'services' on Instance uuid a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:14:07.131512 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:07.209702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9c722198-e6b4-4c14-9bf5-4fbb6c3e5db9 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments/f420fa54-c3c1-4227-969f-297580a571c7" status: 202 len: 0 microversion: 2.1 time: 0.192365 Jun 28 12:14:07.210293 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 445/869] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:14:07 2022] DELETE /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments/f420fa54-c3c1-4227-969f-297580a571c7 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:14:07.775452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ab7aec96-f3c6-414a-9649-9d0a0ac07807 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:07.776452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ab7aec96-f3c6-414a-9649-9d0a0ac07807 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:07.785392 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab7aec96-f3c6-414a-9649-9d0a0ac07807 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:07.785844 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab7aec96-f3c6-414a-9649-9d0a0ac07807 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:07.786614 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab7aec96-f3c6-414a-9649-9d0a0ac07807 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:07.788970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab7aec96-f3c6-414a-9649-9d0a0ac07807 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:07.927764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab7aec96-f3c6-414a-9649-9d0a0ac07807 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:07.935334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ab7aec96-f3c6-414a-9649-9d0a0ac07807 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.166497 Jun 28 12:14:07.935906 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 425/870] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:07 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:08.838251 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:14:08.838894 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Tue Jun 28 12:14:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:14:08.958662 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-92bec512-bcef-4de0-b28c-fdb748100957 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:08.959815 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-92bec512-bcef-4de0-b28c-fdb748100957 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:08.969837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-92bec512-bcef-4de0-b28c-fdb748100957 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:08.970290 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-92bec512-bcef-4de0-b28c-fdb748100957 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:08.971055 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-92bec512-bcef-4de0-b28c-fdb748100957 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:08.971493 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-92bec512-bcef-4de0-b28c-fdb748100957 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:09.115524 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-92bec512-bcef-4de0-b28c-fdb748100957 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:09.123124 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-92bec512-bcef-4de0-b28c-fdb748100957 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.172980 Jun 28 12:14:09.123681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 446/871] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:08 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:10.139657 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-364e84d0-1881-4590-bdbc-46d786684f68 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:10.140273 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-364e84d0-1881-4590-bdbc-46d786684f68 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:10.147105 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-364e84d0-1881-4590-bdbc-46d786684f68 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:10.147567 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-364e84d0-1881-4590-bdbc-46d786684f68 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:10.148341 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-364e84d0-1881-4590-bdbc-46d786684f68 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:10.148787 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-364e84d0-1881-4590-bdbc-46d786684f68 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:10.312426 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-364e84d0-1881-4590-bdbc-46d786684f68 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:10.320557 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-364e84d0-1881-4590-bdbc-46d786684f68 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.184786 Jun 28 12:14:10.321171 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 426/872] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:10 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:11.162445 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-751501626", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "networks": [{"uuid": "78e2b9df-bfb9-4d68-82c9-736e2be74e50"}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:11.215068 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] validate_networks() for [('78e2b9df-bfb9-4d68-82c9-736e2be74e50', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:14:11.340056 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-83d8a14d-42f5-4b97-9a95-e71145aa2579 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:11.340689 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-83d8a14d-42f5-4b97-9a95-e71145aa2579 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:11.348558 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-83d8a14d-42f5-4b97-9a95-e71145aa2579 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:11.349052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-83d8a14d-42f5-4b97-9a95-e71145aa2579 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:11.349832 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-83d8a14d-42f5-4b97-9a95-e71145aa2579 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:11.350276 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-83d8a14d-42f5-4b97-9a95-e71145aa2579 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:11.487071 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-83d8a14d-42f5-4b97-9a95-e71145aa2579 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:11.496811 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-83d8a14d-42f5-4b97-9a95-e71145aa2579 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.162097 Jun 28 12:14:11.498332 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 427/873] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:11 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:11.580583 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:14:11.581026 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:14:11.581464 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:14:11.582219 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:14:11.582619 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:14:11.592731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:11.593145 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:11.594457 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:11.594889 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:11.612263 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Getting quotas for project 2ac1aab84e994f7892964ff85819002d. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:14:11.616593 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Getting quotas for user ddb9e04ba5c046398965b7e79eb3280b and project 2ac1aab84e994f7892964ff85819002d. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:14:11.628762 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:14:11.631044 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:14:11.681013 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-eb5c3027-ed0f-48b9-8e27-57a5c0266eaf tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522398 Jun 28 12:14:11.681926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 447/874] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:14:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:14:11.691862 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-21753cbc-b1cb-47bf-bec5-29d9ebb410af tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:11.692466 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-21753cbc-b1cb-47bf-bec5-29d9ebb410af tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:11.745456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-21753cbc-b1cb-47bf-bec5-29d9ebb410af tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:11.752707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-21753cbc-b1cb-47bf-bec5-29d9ebb410af tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1218 microversion: 2.1 time: 0.064943 Jun 28 12:14:11.753304 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 428/875] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:11 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:12.347344 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-ca282485-4315-4338-90d9-536705f92c5e req-076b499c-f192-4ff8-85a0-44ee26c717f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1cbbba-49fd-4642-850d-b38e9dd57dd1", "name": "network-vif-plugged", "status": "completed", "tag": "f866ebc7-18e6-4ceb-b17b-1bd22be179a3"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:12.357563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-ca282485-4315-4338-90d9-536705f92c5e req-076b499c-f192-4ff8-85a0-44ee26c717f7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:12.358061 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-ca282485-4315-4338-90d9-536705f92c5e req-076b499c-f192-4ff8-85a0-44ee26c717f7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:12.372488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-ca282485-4315-4338-90d9-536705f92c5e req-076b499c-f192-4ff8-85a0-44ee26c717f7 service nova] Creating event network-vif-plugged:f866ebc7-18e6-4ceb-b17b-1bd22be179a3 for instance ca1cbbba-49fd-4642-850d-b38e9dd57dd1 on hv-cinder-84795 Jun 28 12:14:12.377662 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-ca282485-4315-4338-90d9-536705f92c5e req-076b499c-f192-4ff8-85a0-44ee26c717f7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034613 Jun 28 12:14:12.378231 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 448/876] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:12.517514 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a137b982-0c69-4b50-8a58-7f41dfdecc71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:12.518135 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a137b982-0c69-4b50-8a58-7f41dfdecc71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:12.526023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a137b982-0c69-4b50-8a58-7f41dfdecc71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:12.526479 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a137b982-0c69-4b50-8a58-7f41dfdecc71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:12.527304 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a137b982-0c69-4b50-8a58-7f41dfdecc71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:12.527744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a137b982-0c69-4b50-8a58-7f41dfdecc71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:12.568637 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6c158220-bcb9-4305-b2c7-f30612900a55 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:12.569362 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6c158220-bcb9-4305-b2c7-f30612900a55 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:12.575832 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c158220-bcb9-4305-b2c7-f30612900a55 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:12.576289 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c158220-bcb9-4305-b2c7-f30612900a55 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:12.577093 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c158220-bcb9-4305-b2c7-f30612900a55 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:12.577532 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6c158220-bcb9-4305-b2c7-f30612900a55 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:12.611313 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6c158220-bcb9-4305-b2c7-f30612900a55 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments/05c775ad-45ad-4ce7-ba77-854fdce8f9b5" status: 200 len: 194 microversion: 2.1 time: 0.047088 Jun 28 12:14:12.611913 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 449/877] 10.222.0.55 () {58 vars in 1412 bytes} [Tue Jun 28 12:14:12 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments/05c775ad-45ad-4ce7-ba77-854fdce8f9b5 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:12.627537 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fa8cf79d-59c9-4924-9fd0-2b9fc97a3f16 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:12.628070 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fa8cf79d-59c9-4924-9fd0-2b9fc97a3f16 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:12.634565 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa8cf79d-59c9-4924-9fd0-2b9fc97a3f16 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:12.635018 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa8cf79d-59c9-4924-9fd0-2b9fc97a3f16 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:12.635822 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa8cf79d-59c9-4924-9fd0-2b9fc97a3f16 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:12.636258 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa8cf79d-59c9-4924-9fd0-2b9fc97a3f16 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:12.677565 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a137b982-0c69-4b50-8a58-7f41dfdecc71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:12.687421 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a137b982-0c69-4b50-8a58-7f41dfdecc71 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.175086 Jun 28 12:14:12.688438 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 429/878] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:12 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:12.727756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-fa8cf79d-59c9-4924-9fd0-2b9fc97a3f16 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lazy-loading 'services' on Instance uuid a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:14:12.774123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e40f3b4e-15a1-4a0c-9571-b80c5c80ef7c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:12.774556 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e40f3b4e-15a1-4a0c-9571-b80c5c80ef7c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:12.791820 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e40f3b4e-15a1-4a0c-9571-b80c5c80ef7c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:12.792306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e40f3b4e-15a1-4a0c-9571-b80c5c80ef7c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:12.803309 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e40f3b4e-15a1-4a0c-9571-b80c5c80ef7c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:12.803759 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e40f3b4e-15a1-4a0c-9571-b80c5c80ef7c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:12.852444 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fa8cf79d-59c9-4924-9fd0-2b9fc97a3f16 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments/05c775ad-45ad-4ce7-ba77-854fdce8f9b5" status: 202 len: 0 microversion: 2.1 time: 0.231685 Jun 28 12:14:12.859730 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 450/879] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:14:12 2022] DELETE /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments/05c775ad-45ad-4ce7-ba77-854fdce8f9b5 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 12:14:12.900262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e40f3b4e-15a1-4a0c-9571-b80c5c80ef7c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:12.909325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e40f3b4e-15a1-4a0c-9571-b80c5c80ef7c tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1278 microversion: 2.1 time: 0.143183 Jun 28 12:14:12.910385 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 430/880] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:12 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1278 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:14:13.705968 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ba614bcd-f08f-4d00-a6b8-3fc063e766c1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:13.707065 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ba614bcd-f08f-4d00-a6b8-3fc063e766c1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:13.713959 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba614bcd-f08f-4d00-a6b8-3fc063e766c1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:13.714495 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba614bcd-f08f-4d00-a6b8-3fc063e766c1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:13.715263 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba614bcd-f08f-4d00-a6b8-3fc063e766c1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:13.715699 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ba614bcd-f08f-4d00-a6b8-3fc063e766c1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:13.853250 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ba614bcd-f08f-4d00-a6b8-3fc063e766c1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:13.861338 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ba614bcd-f08f-4d00-a6b8-3fc063e766c1 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.160264 Jun 28 12:14:13.861903 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 451/881] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:13 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:13.931776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ee17793c-c564-4f26-8a58-c618ce4dac6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:13.932748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ee17793c-c564-4f26-8a58-c618ce4dac6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:13.944689 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee17793c-c564-4f26-8a58-c618ce4dac6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:13.945525 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee17793c-c564-4f26-8a58-c618ce4dac6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:13.946799 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee17793c-c564-4f26-8a58-c618ce4dac6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:13.947578 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee17793c-c564-4f26-8a58-c618ce4dac6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:14.095601 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ee17793c-c564-4f26-8a58-c618ce4dac6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:14.104350 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ee17793c-c564-4f26-8a58-c618ce4dac6e tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1318 microversion: 2.1 time: 0.178921 Jun 28 12:14:14.105152 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 431/882] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:13 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:14.878604 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-82e84c8e-d1fa-4ade-9ce4-f9c1defe4911 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:14.879345 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-82e84c8e-d1fa-4ade-9ce4-f9c1defe4911 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:14.886260 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82e84c8e-d1fa-4ade-9ce4-f9c1defe4911 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:14.886700 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82e84c8e-d1fa-4ade-9ce4-f9c1defe4911 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:14.887455 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82e84c8e-d1fa-4ade-9ce4-f9c1defe4911 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:14.887882 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-82e84c8e-d1fa-4ade-9ce4-f9c1defe4911 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:15.101521 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-82e84c8e-d1fa-4ade-9ce4-f9c1defe4911 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:15.104455 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-389fcb3e-0457-4fce-9c58-0ceb233bfc3e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:15.105516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-389fcb3e-0457-4fce-9c58-0ceb233bfc3e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:15.110047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-82e84c8e-d1fa-4ade-9ce4-f9c1defe4911 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1267 microversion: 2.1 time: 0.235090 Jun 28 12:14:15.112401 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-389fcb3e-0457-4fce-9c58-0ceb233bfc3e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:15.113172 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-389fcb3e-0457-4fce-9c58-0ceb233bfc3e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:15.113943 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-389fcb3e-0457-4fce-9c58-0ceb233bfc3e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:15.114544 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-389fcb3e-0457-4fce-9c58-0ceb233bfc3e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:15.119707 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 452/883] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:14 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:15.124561 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-dd4f0bba-783f-433e-8620-5f5a38fe3cf4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:15.125234 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-dd4f0bba-783f-433e-8620-5f5a38fe3cf4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:15.131486 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dd4f0bba-783f-433e-8620-5f5a38fe3cf4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:15.131930 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dd4f0bba-783f-433e-8620-5f5a38fe3cf4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:15.133184 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dd4f0bba-783f-433e-8620-5f5a38fe3cf4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:15.133184 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-dd4f0bba-783f-433e-8620-5f5a38fe3cf4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:15.141136 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:15.146663 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-389fcb3e-0457-4fce-9c58-0ceb233bfc3e tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 Jun 28 12:14:15.147245 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 432/884] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:14:15 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:15.157700 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-df9946e0-4432-4af6-a6b4-2f329851b8e0 req-c9a9ef09-70be-4045-a232-5f293f87927c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb44fc7-6cbc-419a-90a2-ddcba6661c49", "tag": "9ba54c71-9057-40b7-b7a5-c44d43748076"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:15.166686 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-df9946e0-4432-4af6-a6b4-2f329851b8e0 req-c9a9ef09-70be-4045-a232-5f293f87927c service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:15.167126 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-df9946e0-4432-4af6-a6b4-2f329851b8e0 req-c9a9ef09-70be-4045-a232-5f293f87927c service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:15.180675 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-df9946e0-4432-4af6-a6b4-2f329851b8e0 req-c9a9ef09-70be-4045-a232-5f293f87927c service nova] Creating event network-changed:9ba54c71-9057-40b7-b7a5-c44d43748076 for instance 8eb44fc7-6cbc-419a-90a2-ddcba6661c49 on hv-cinder-84795 Jun 28 12:14:15.186032 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-df9946e0-4432-4af6-a6b4-2f329851b8e0 req-c9a9ef09-70be-4045-a232-5f293f87927c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032510 Jun 28 12:14:15.186664 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 433/885] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:15.276698 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-dd4f0bba-783f-433e-8620-5f5a38fe3cf4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:15.284513 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-dd4f0bba-783f-433e-8620-5f5a38fe3cf4 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1318 microversion: 2.1 time: 0.163675 Jun 28 12:14:15.285150 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 453/886] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:15 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:16.127981 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e956985-2939-4821-bf6e-111fdb447df3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:16.128799 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e956985-2939-4821-bf6e-111fdb447df3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:16.135242 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e956985-2939-4821-bf6e-111fdb447df3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.135701 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e956985-2939-4821-bf6e-111fdb447df3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.136468 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e956985-2939-4821-bf6e-111fdb447df3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.136938 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e956985-2939-4821-bf6e-111fdb447df3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.158803 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8e82da58-c397-4929-a05f-28c19b5270e2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:16.159788 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8e82da58-c397-4929-a05f-28c19b5270e2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:16.166899 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e82da58-c397-4929-a05f-28c19b5270e2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.167350 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e82da58-c397-4929-a05f-28c19b5270e2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.168114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e82da58-c397-4929-a05f-28c19b5270e2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.168544 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8e82da58-c397-4929-a05f-28c19b5270e2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.199105 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8e82da58-c397-4929-a05f-28c19b5270e2 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044374 Jun 28 12:14:16.199676 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 454/887] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:14:16 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 12:14:16.283462 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e956985-2939-4821-bf6e-111fdb447df3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:16.291157 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e956985-2939-4821-bf6e-111fdb447df3 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1453 microversion: 2.1 time: 0.168204 Jun 28 12:14:16.291704 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 434/888] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:16 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:16.301797 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6a2839d0-387a-4443-9dac-6e5efe690860 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:16.302490 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6a2839d0-387a-4443-9dac-6e5efe690860 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:16.308430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fa176f0b-ddae-4f25-8c34-4cacd8f3a5d2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:16.309185 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fa176f0b-ddae-4f25-8c34-4cacd8f3a5d2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:16.309336 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a2839d0-387a-4443-9dac-6e5efe690860 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.309702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a2839d0-387a-4443-9dac-6e5efe690860 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.310480 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a2839d0-387a-4443-9dac-6e5efe690860 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.310894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6a2839d0-387a-4443-9dac-6e5efe690860 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.315352 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa176f0b-ddae-4f25-8c34-4cacd8f3a5d2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.315796 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa176f0b-ddae-4f25-8c34-4cacd8f3a5d2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.316552 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa176f0b-ddae-4f25-8c34-4cacd8f3a5d2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.317012 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa176f0b-ddae-4f25-8c34-4cacd8f3a5d2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.446595 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6a2839d0-387a-4443-9dac-6e5efe690860 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:16.452611 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fa176f0b-ddae-4f25-8c34-4cacd8f3a5d2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:16.454185 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6a2839d0-387a-4443-9dac-6e5efe690860 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1318 microversion: 2.1 time: 0.156293 Jun 28 12:14:16.454751 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 455/889] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:16 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:16.460133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9d1612e6-30a4-4efa-910a-665289a95865 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:16.461073 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9d1612e6-30a4-4efa-910a-665289a95865 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:16.461545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fa176f0b-ddae-4f25-8c34-4cacd8f3a5d2 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1453 microversion: 2.1 time: 0.157064 Jun 28 12:14:16.462111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 435/890] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:16 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:16.467595 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d1612e6-30a4-4efa-910a-665289a95865 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.468033 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d1612e6-30a4-4efa-910a-665289a95865 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.468784 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d1612e6-30a4-4efa-910a-665289a95865 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.469313 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9d1612e6-30a4-4efa-910a-665289a95865 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.499051 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9d1612e6-30a4-4efa-910a-665289a95865 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042977 Jun 28 12:14:16.499609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 456/891] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:14:16 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 12:14:16.557572 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a71b8d8a-dd35-4463-acf3-5b9b07b1ae8d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:16.558064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a71b8d8a-dd35-4463-acf3-5b9b07b1ae8d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:16.564737 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a71b8d8a-dd35-4463-acf3-5b9b07b1ae8d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.565292 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a71b8d8a-dd35-4463-acf3-5b9b07b1ae8d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.566268 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a71b8d8a-dd35-4463-acf3-5b9b07b1ae8d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.566715 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a71b8d8a-dd35-4463-acf3-5b9b07b1ae8d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.593386 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a71b8d8a-dd35-4463-acf3-5b9b07b1ae8d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:14:16.672270 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a71b8d8a-dd35-4463-acf3-5b9b07b1ae8d tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 204 len: 0 microversion: 2.1 time: 0.118197 Jun 28 12:14:16.672869 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 436/892] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:14:16 2022] DELETE /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:14:16.681186 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a3528890-387b-4196-93f7-919840543a60 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:16.681796 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a3528890-387b-4196-93f7-919840543a60 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:16.687980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3528890-387b-4196-93f7-919840543a60 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.688434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3528890-387b-4196-93f7-919840543a60 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.689395 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3528890-387b-4196-93f7-919840543a60 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:16.689837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3528890-387b-4196-93f7-919840543a60 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:16.824117 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a3528890-387b-4196-93f7-919840543a60 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:16.832722 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a3528890-387b-4196-93f7-919840543a60 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1673 microversion: 2.1 time: 0.155444 Jun 28 12:14:16.833325 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 457/893] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:16 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:17.473035 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4ca833a6-f5fa-4649-a4a2-7d4e18848012 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:17.474703 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4ca833a6-f5fa-4649-a4a2-7d4e18848012 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:17.482337 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ca833a6-f5fa-4649-a4a2-7d4e18848012 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:17.482797 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ca833a6-f5fa-4649-a4a2-7d4e18848012 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:17.483568 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ca833a6-f5fa-4649-a4a2-7d4e18848012 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:17.484015 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ca833a6-f5fa-4649-a4a2-7d4e18848012 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:17.694493 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4ca833a6-f5fa-4649-a4a2-7d4e18848012 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:17.702406 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4ca833a6-f5fa-4649-a4a2-7d4e18848012 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1318 microversion: 2.1 time: 0.234142 Jun 28 12:14:17.702979 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 437/894] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:17 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:17.850589 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-81951ff1-a8c5-4d79-bf36-2fe9628e271f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:17.851193 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-81951ff1-a8c5-4d79-bf36-2fe9628e271f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:17.858130 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81951ff1-a8c5-4d79-bf36-2fe9628e271f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:17.858573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81951ff1-a8c5-4d79-bf36-2fe9628e271f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:17.859331 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81951ff1-a8c5-4d79-bf36-2fe9628e271f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:17.859738 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-81951ff1-a8c5-4d79-bf36-2fe9628e271f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:17.994351 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-81951ff1-a8c5-4d79-bf36-2fe9628e271f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:18.002464 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-81951ff1-a8c5-4d79-bf36-2fe9628e271f tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1673 microversion: 2.1 time: 0.155862 Jun 28 12:14:18.003229 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 458/895] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:17 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:18.287789 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-37104cc1-2c08-4485-bba8-72088634ac31 req-4a49def3-66ad-42bd-9d0d-e3963c1d174c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1cbbba-49fd-4642-850d-b38e9dd57dd1", "tag": "f866ebc7-18e6-4ceb-b17b-1bd22be179a3"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:18.296694 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-37104cc1-2c08-4485-bba8-72088634ac31 req-4a49def3-66ad-42bd-9d0d-e3963c1d174c service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:18.297183 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-37104cc1-2c08-4485-bba8-72088634ac31 req-4a49def3-66ad-42bd-9d0d-e3963c1d174c service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:18.308566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-37104cc1-2c08-4485-bba8-72088634ac31 req-4a49def3-66ad-42bd-9d0d-e3963c1d174c service nova] Creating event network-changed:f866ebc7-18e6-4ceb-b17b-1bd22be179a3 for instance ca1cbbba-49fd-4642-850d-b38e9dd57dd1 on hv-cinder-84795 Jun 28 12:14:18.313668 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-37104cc1-2c08-4485-bba8-72088634ac31 req-4a49def3-66ad-42bd-9d0d-e3963c1d174c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029725 Jun 28 12:14:18.314265 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 438/896] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:18.720133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6fa68a65-ee6e-43a4-ad26-8eba9a272d88 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:18.720894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6fa68a65-ee6e-43a4-ad26-8eba9a272d88 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:18.727644 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6fa68a65-ee6e-43a4-ad26-8eba9a272d88 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:18.728121 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6fa68a65-ee6e-43a4-ad26-8eba9a272d88 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:18.728937 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6fa68a65-ee6e-43a4-ad26-8eba9a272d88 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:18.729365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6fa68a65-ee6e-43a4-ad26-8eba9a272d88 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:18.866874 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6fa68a65-ee6e-43a4-ad26-8eba9a272d88 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:18.874886 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6fa68a65-ee6e-43a4-ad26-8eba9a272d88 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1318 microversion: 2.1 time: 0.158871 Jun 28 12:14:18.875453 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 459/897] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:18 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:19.020941 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5baa5d77-1b99-4f36-8e9c-cd93cd647144 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:19.021663 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5baa5d77-1b99-4f36-8e9c-cd93cd647144 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:19.028060 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5baa5d77-1b99-4f36-8e9c-cd93cd647144 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:19.028513 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5baa5d77-1b99-4f36-8e9c-cd93cd647144 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:19.029317 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5baa5d77-1b99-4f36-8e9c-cd93cd647144 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:19.029757 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5baa5d77-1b99-4f36-8e9c-cd93cd647144 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:19.170666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5baa5d77-1b99-4f36-8e9c-cd93cd647144 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:19.179123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5baa5d77-1b99-4f36-8e9c-cd93cd647144 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1673 microversion: 2.1 time: 0.163009 Jun 28 12:14:19.179696 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 439/898] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:19 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:19.895702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-84f3c70d-4955-49a0-a39f-a373110309ba tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:19.896337 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-84f3c70d-4955-49a0-a39f-a373110309ba tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:19.904301 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-84f3c70d-4955-49a0-a39f-a373110309ba tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:19.904827 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-84f3c70d-4955-49a0-a39f-a373110309ba tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:19.905709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-84f3c70d-4955-49a0-a39f-a373110309ba tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:19.906188 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-84f3c70d-4955-49a0-a39f-a373110309ba tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:20.124584 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-84f3c70d-4955-49a0-a39f-a373110309ba tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:20.133341 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-84f3c70d-4955-49a0-a39f-a373110309ba tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1318 microversion: 2.1 time: 0.243182 Jun 28 12:14:20.133921 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 460/899] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:19 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:20.196310 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-64169a06-eb04-4594-83a2-f78634638250 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:20.196936 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-64169a06-eb04-4594-83a2-f78634638250 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:20.203834 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64169a06-eb04-4594-83a2-f78634638250 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:20.204380 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64169a06-eb04-4594-83a2-f78634638250 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:20.205206 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64169a06-eb04-4594-83a2-f78634638250 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:20.205644 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64169a06-eb04-4594-83a2-f78634638250 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:20.351435 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-64169a06-eb04-4594-83a2-f78634638250 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:20.361673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-64169a06-eb04-4594-83a2-f78634638250 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1673 microversion: 2.1 time: 0.168228 Jun 28 12:14:20.362606 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 440/900] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:20 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:21.150713 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-750626d1-9154-488f-b808-b8f0e13da93b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:21.151996 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-750626d1-9154-488f-b808-b8f0e13da93b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:21.159725 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-750626d1-9154-488f-b808-b8f0e13da93b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:21.160489 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-750626d1-9154-488f-b808-b8f0e13da93b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:21.161501 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-750626d1-9154-488f-b808-b8f0e13da93b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:21.162276 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-750626d1-9154-488f-b808-b8f0e13da93b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:21.379896 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-305106b8-413d-4d8f-8b5c-cf67d96518d6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:21.380518 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-305106b8-413d-4d8f-8b5c-cf67d96518d6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:21.387507 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-305106b8-413d-4d8f-8b5c-cf67d96518d6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:21.387998 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-305106b8-413d-4d8f-8b5c-cf67d96518d6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:21.388774 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-305106b8-413d-4d8f-8b5c-cf67d96518d6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:21.389275 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-305106b8-413d-4d8f-8b5c-cf67d96518d6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:21.402356 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-750626d1-9154-488f-b808-b8f0e13da93b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:21.411128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-750626d1-9154-488f-b808-b8f0e13da93b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1318 microversion: 2.1 time: 0.264218 Jun 28 12:14:21.412013 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 461/901] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:21 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:21.534467 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-305106b8-413d-4d8f-8b5c-cf67d96518d6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8d8d0c23f744a7b9ad311581f6ae39f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73679a9c1e1140dab3237b74ff50d3c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:21.542725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-305106b8-413d-4d8f-8b5c-cf67d96518d6 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 200 len: 1673 microversion: 2.1 time: 0.167026 Jun 28 12:14:21.543606 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 441/902] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:21 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:21.798942 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-59c046ab-b3e8-43d4-8f04-61ec6a6e9a42 req-39472445-37e3-417e-81c9-00b2a483ca01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ce26f4-7e77-4c12-a6b2-2136cbde62f0", "name": "network-vif-deleted", "tag": "1d1376e8-5fa7-4892-8dbf-b575fdecaa09"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:21.804098 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:21.804920 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:21.810698 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-59c046ab-b3e8-43d4-8f04-61ec6a6e9a42 req-39472445-37e3-417e-81c9-00b2a483ca01 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:21.811754 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-59c046ab-b3e8-43d4-8f04-61ec6a6e9a42 req-39472445-37e3-417e-81c9-00b2a483ca01 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:21.825290 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-59c046ab-b3e8-43d4-8f04-61ec6a6e9a42 req-39472445-37e3-417e-81c9-00b2a483ca01 service nova] Creating event network-vif-deleted:1d1376e8-5fa7-4892-8dbf-b575fdecaa09 for instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 on hv-cinder-84795 Jun 28 12:14:21.831062 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-59c046ab-b3e8-43d4-8f04-61ec6a6e9a42 req-39472445-37e3-417e-81c9-00b2a483ca01 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035992 Jun 28 12:14:21.832113 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 462/903] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:22.428717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bc00c932-9892-437a-8ca2-f73b4e3105ed tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:22.429336 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bc00c932-9892-437a-8ca2-f73b4e3105ed tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:22.432453 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:22.436856 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc00c932-9892-437a-8ca2-f73b4e3105ed tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:22.437323 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc00c932-9892-437a-8ca2-f73b4e3105ed tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:22.438097 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc00c932-9892-437a-8ca2-f73b4e3105ed tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:22.438618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc00c932-9892-437a-8ca2-f73b4e3105ed tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:22.564103 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b45f70df-2d58-4a6e-bc42-5b0fcb8031b1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:22.565945 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b45f70df-2d58-4a6e-bc42-5b0fcb8031b1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:22.577542 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b45f70df-2d58-4a6e-bc42-5b0fcb8031b1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:22.578859 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b45f70df-2d58-4a6e-bc42-5b0fcb8031b1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:22.580368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b45f70df-2d58-4a6e-bc42-5b0fcb8031b1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:22.581090 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b45f70df-2d58-4a6e-bc42-5b0fcb8031b1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:22.590158 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bc00c932-9892-437a-8ca2-f73b4e3105ed tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:22.598875 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-b45f70df-2d58-4a6e-bc42-5b0fcb8031b1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] HTTP exception thrown: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:22.599290 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bc00c932-9892-437a-8ca2-f73b4e3105ed tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1318 microversion: 2.1 time: 0.174994 Jun 28 12:14:22.600223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 442/904] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:22 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b45f70df-2d58-4a6e-bc42-5b0fcb8031b1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Request method failure captured: Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 HTTP/1.1 Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5WBVl25gC-2Te4R1WPROBRk_Ii8KNQDjsDx91jHO6ZWma02ekChdDed564Egd7I_j9lLDzxcblpCXdQ-Gw7e3BEdLvofFszBr-z1Eq0EhMFuVepdZfmw6gPNEUrqq8ykrgiL3anCcG6djN7zK-sMEJEEk7FCAm5IyCv_JcBurYZx8 Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:14:22.601460 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}] Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: b8d8d0c23f744a7b9ad311581f6ae39f Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:22.602811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': 'a0ce26f4-7e77-4c12-a6b2-2136cbde62f0'} Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:14:22.603585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:22.604808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:22.606954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-9aa127cb-480d-48b4-9c9f-0df525a02917 req-7e9f5ab1-783e-4a8f-8233-4614e3e55f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb44fc7-6cbc-419a-90a2-ddcba6661c49", "name": "network-vif-plugged", "status": "completed", "tag": "9ba54c71-9057-40b7-b7a5-c44d43748076"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:22.607803 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b45f70df-2d58-4a6e-bc42-5b0fcb8031b1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Returning 404 to user: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:14:22.609848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b45f70df-2d58-4a6e-bc42-5b0fcb8031b1 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 404 len: 111 microversion: 2.1 time: 0.051152 Jun 28 12:14:22.611675 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 463/905] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:22 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:14:22.617977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9aa127cb-480d-48b4-9c9f-0df525a02917 req-7e9f5ab1-783e-4a8f-8233-4614e3e55f64 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:22.618566 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-9aa127cb-480d-48b4-9c9f-0df525a02917 req-7e9f5ab1-783e-4a8f-8233-4614e3e55f64 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:22.621437 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4e515799-5eda-4fed-9950-91db221a8dbb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '.version_select at 0x7f3932b87820>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:22.637206 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-9aa127cb-480d-48b4-9c9f-0df525a02917 req-7e9f5ab1-783e-4a8f-8233-4614e3e55f64 service nova] Creating event network-vif-plugged:9ba54c71-9057-40b7-b7a5-c44d43748076 for instance 8eb44fc7-6cbc-419a-90a2-ddcba6661c49 on hv-cinder-84795 Jun 28 12:14:22.645622 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-9aa127cb-480d-48b4-9c9f-0df525a02917 req-7e9f5ab1-783e-4a8f-8233-4614e3e55f64 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043912 Jun 28 12:14:22.646659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 443/906] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:22.651732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4e515799-5eda-4fed-9950-91db221a8dbb tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-343074167" status: 202 len: 0 microversion: 2.1 time: 0.035184 Jun 28 12:14:22.652317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 464/907] 10.222.0.55 () {58 vars in 1217 bytes} [Tue Jun 28 12:14:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-343074167 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:14:23.617296 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-11598872-f1b6-4f22-83dd-674faf9c4727 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:23.618023 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-11598872-f1b6-4f22-83dd-674faf9c4727 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:23.624867 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11598872-f1b6-4f22-83dd-674faf9c4727 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:23.625318 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11598872-f1b6-4f22-83dd-674faf9c4727 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:23.626070 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11598872-f1b6-4f22-83dd-674faf9c4727 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:23.627136 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-11598872-f1b6-4f22-83dd-674faf9c4727 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:23.778193 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-11598872-f1b6-4f22-83dd-674faf9c4727 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:23.786258 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-11598872-f1b6-4f22-83dd-674faf9c4727 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1318 microversion: 2.1 time: 0.173791 Jun 28 12:14:23.786876 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 444/908] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:23 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:24.806119 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-26666c7b-03f7-48aa-8c05-891fe327be65 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:24.806731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-26666c7b-03f7-48aa-8c05-891fe327be65 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:24.816015 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-26666c7b-03f7-48aa-8c05-891fe327be65 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:24.816488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-26666c7b-03f7-48aa-8c05-891fe327be65 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:24.817292 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-26666c7b-03f7-48aa-8c05-891fe327be65 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:24.817728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-26666c7b-03f7-48aa-8c05-891fe327be65 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:24.821918 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:25.003380 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-26666c7b-03f7-48aa-8c05-891fe327be65 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:25.011577 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-26666c7b-03f7-48aa-8c05-891fe327be65 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1318 microversion: 2.1 time: 0.209878 Jun 28 12:14:25.012293 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 465/909] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:24 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:25.647348 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6d79ad4f-deb6-4af3-94b1-23a49183e555 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:25.647914 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6d79ad4f-deb6-4af3-94b1-23a49183e555 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:25.654874 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d79ad4f-deb6-4af3-94b1-23a49183e555 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:25.655329 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d79ad4f-deb6-4af3-94b1-23a49183e555 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:25.656100 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d79ad4f-deb6-4af3-94b1-23a49183e555 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:25.656533 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d79ad4f-deb6-4af3-94b1-23a49183e555 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:25.670214 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-6d79ad4f-deb6-4af3-94b1-23a49183e555 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] HTTP exception thrown: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6d79ad4f-deb6-4af3-94b1-23a49183e555 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Request method failure captured: Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 HTTP/1.1 Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu5WBVl25gC-2Te4R1WPROBRk_Ii8KNQDjsDx91jHO6ZWma02ekChdDed564Egd7I_j9lLDzxcblpCXdQ-Gw7e3BEdLvofFszBr-z1Eq0EhMFuVepdZfmw6gPNEUrqq8ykrgiL3anCcG6djN7zK-sMEJEEk7FCAm5IyCv_JcBurYZx8 Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:14:25.671878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}] Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: b8d8d0c23f744a7b9ad311581f6ae39f Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:25.673545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'a0ce26f4-7e77-4c12-a6b2-2136cbde62f0'} Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:14:25.674577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:25.676130 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:25.677831 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6d79ad4f-deb6-4af3-94b1-23a49183e555 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Returning 404 to user: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:14:25.677831 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6d79ad4f-deb6-4af3-94b1-23a49183e555 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 404 len: 111 microversion: 2.1 time: 0.029992 Jun 28 12:14:25.677831 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 445/910] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:14:25 2022] DELETE /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:14:25.681788 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-baccce23-42bc-48cd-8cf5-a47c882eb2ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:25.682420 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-baccce23-42bc-48cd-8cf5-a47c882eb2ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: a0ce26f4-7e77-4c12-a6b2-2136cbde62f0] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:25.688870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baccce23-42bc-48cd-8cf5-a47c882eb2ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:25.689365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baccce23-42bc-48cd-8cf5-a47c882eb2ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:25.690134 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baccce23-42bc-48cd-8cf5-a47c882eb2ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:25.690569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-baccce23-42bc-48cd-8cf5-a47c882eb2ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:25.704400 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-baccce23-42bc-48cd-8cf5-a47c882eb2ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] HTTP exception thrown: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-baccce23-42bc-48cd-8cf5-a47c882eb2ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Request method failure captured: Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 HTTP/1.1 Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5WBVl25gC-2Te4R1WPROBRk_Ii8KNQDjsDx91jHO6ZWma02ekChdDed564Egd7I_j9lLDzxcblpCXdQ-Gw7e3BEdLvofFszBr-z1Eq0EhMFuVepdZfmw6gPNEUrqq8ykrgiL3anCcG6djN7zK-sMEJEEk7FCAm5IyCv_JcBurYZx8 Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:14:25.705955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}] Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: b8d8d0c23f744a7b9ad311581f6ae39f Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:25.707805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': 'a0ce26f4-7e77-4c12-a6b2-2136cbde62f0'} Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:14:25.708689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. Jun 28 12:14:25.710106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:25.711410 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-baccce23-42bc-48cd-8cf5-a47c882eb2ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Returning 404 to user: Instance a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:14:25.711410 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-baccce23-42bc-48cd-8cf5-a47c882eb2ee tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0" status: 404 len: 111 microversion: 2.1 time: 0.029771 Jun 28 12:14:25.711410 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 466/911] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:25 2022] GET /compute/v2.1/servers/a0ce26f4-7e77-4c12-a6b2-2136cbde62f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:14:26.034038 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0203d8d0-98c0-4334-a43f-27fcf1c31131 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:26.034971 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0203d8d0-98c0-4334-a43f-27fcf1c31131 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:26.044770 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0203d8d0-98c0-4334-a43f-27fcf1c31131 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:26.045518 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0203d8d0-98c0-4334-a43f-27fcf1c31131 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:26.046725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0203d8d0-98c0-4334-a43f-27fcf1c31131 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:26.047360 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0203d8d0-98c0-4334-a43f-27fcf1c31131 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:26.185723 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0203d8d0-98c0-4334-a43f-27fcf1c31131 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:26.194115 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0203d8d0-98c0-4334-a43f-27fcf1c31131 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1508 microversion: 2.1 time: 0.165939 Jun 28 12:14:26.194703 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 446/912] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:26 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:26.211996 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-13f39dd2-4290-476c-a39a-778a6988291b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "166a9641-7db8-4228-8840-e4d2b5851ecc", "device": "/dev/sdb"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:26.213134 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-13f39dd2-4290-476c-a39a-778a6988291b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:26.220325 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13f39dd2-4290-476c-a39a-778a6988291b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:26.220773 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13f39dd2-4290-476c-a39a-778a6988291b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:26.221570 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13f39dd2-4290-476c-a39a-778a6988291b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:26.222015 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-13f39dd2-4290-476c-a39a-778a6988291b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:26.488538 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-13f39dd2-4290-476c-a39a-778a6988291b tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "POST /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280551 Jun 28 12:14:26.489224 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 467/913] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:14:26 2022] POST /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:26.847013 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e93aa1b6-b28c-4be2-9ff5-e5bcb6b24e54 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:26.847506 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e93aa1b6-b28c-4be2-9ff5-e5bcb6b24e54 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:26.854531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e93aa1b6-b28c-4be2-9ff5-e5bcb6b24e54 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:26.854982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e93aa1b6-b28c-4be2-9ff5-e5bcb6b24e54 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:26.855745 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e93aa1b6-b28c-4be2-9ff5-e5bcb6b24e54 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:26.856182 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e93aa1b6-b28c-4be2-9ff5-e5bcb6b24e54 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:26.870553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-e93aa1b6-b28c-4be2-9ff5-e5bcb6b24e54 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] HTTP exception thrown: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e93aa1b6-b28c-4be2-9ff5-e5bcb6b24e54 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Request method failure captured: Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de HTTP/1.1 Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu5WBVl25gC-2Te4R1WPROBRk_Ii8KNQDjsDx91jHO6ZWma02ekChdDed564Egd7I_j9lLDzxcblpCXdQ-Gw7e3BEdLvofFszBr-z1Eq0EhMFuVepdZfmw6gPNEUrqq8ykrgiL3anCcG6djN7zK-sMEJEEk7FCAm5IyCv_JcBurYZx8 Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:14:26.872111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}] Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: b8d8d0c23f744a7b9ad311581f6ae39f Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:14:26.873727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'ed81e0c7-a44e-497b-bf2e-cf208dd340de'} Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:14:26.874569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:14:26.875951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:26.877414 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e93aa1b6-b28c-4be2-9ff5-e5bcb6b24e54 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Returning 404 to user: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:14:26.877414 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e93aa1b6-b28c-4be2-9ff5-e5bcb6b24e54 tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 404 len: 111 microversion: 2.1 time: 0.030384 Jun 28 12:14:26.877414 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 447/914] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:14:26 2022] DELETE /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:14:26.882935 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-79d639f7-cfa9-41d9-9dfc-b89637592fea tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:26.883637 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-79d639f7-cfa9-41d9-9dfc-b89637592fea tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] [instance: ed81e0c7-a44e-497b-bf2e-cf208dd340de] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:26.890777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79d639f7-cfa9-41d9-9dfc-b89637592fea tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:26.891226 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79d639f7-cfa9-41d9-9dfc-b89637592fea tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:26.891994 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79d639f7-cfa9-41d9-9dfc-b89637592fea tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:26.892429 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-79d639f7-cfa9-41d9-9dfc-b89637592fea tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:26.906332 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-79d639f7-cfa9-41d9-9dfc-b89637592fea tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] HTTP exception thrown: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-79d639f7-cfa9-41d9-9dfc-b89637592fea tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Request method failure captured: Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de HTTP/1.1 Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5WBVl25gC-2Te4R1WPROBRk_Ii8KNQDjsDx91jHO6ZWma02ekChdDed564Egd7I_j9lLDzxcblpCXdQ-Gw7e3BEdLvofFszBr-z1Eq0EhMFuVepdZfmw6gPNEUrqq8ykrgiL3anCcG6djN7zK-sMEJEEk7FCAm5IyCv_JcBurYZx8 Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:14:26.907999 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_73679a9c1e1140dab3237b74ff50d3c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/73679a9c1e1140dab3237b74ff50d3c8"}]}] Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 73679a9c1e1140dab3237b74ff50d3c8 Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeTestJSON-824845849 Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: b8d8d0c23f744a7b9ad311581f6ae39f Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeTestJSON-824845849-project Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:14:26.909511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': 'ed81e0c7-a44e-497b-bf2e-cf208dd340de'} Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:14:26.910371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. Jun 28 12:14:26.911728 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:14:26.913712 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-79d639f7-cfa9-41d9-9dfc-b89637592fea tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] Returning 404 to user: Instance ed81e0c7-a44e-497b-bf2e-cf208dd340de could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:14:26.913712 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-79d639f7-cfa9-41d9-9dfc-b89637592fea tempest-AttachVolumeTestJSON-824845849 tempest-AttachVolumeTestJSON-824845849-project] 10.222.0.55 "GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de" status: 404 len: 111 microversion: 2.1 time: 0.030689 Jun 28 12:14:26.913712 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 468/915] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:26 2022] GET /compute/v2.1/servers/ed81e0c7-a44e-497b-bf2e-cf208dd340de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:14:35.942412 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d6b4423e-4796-45fc-bad7-a37ebeea515e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: .version_select at 0x7f3932d12670>, body: {"keypair": {"name": "tempest-keypair-1979653189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWSAVnonV+nxUUm+md7ssvePG/rl2rYYEdtycrZgMnxJfXH8IKb/HrzzuRxpn4mw60UzV9TI/TxPqRk1E3UZWvoGqvhpCR3n2pQ9xj6TbQN78FSNzj5UYjzD9lfCjKt0Q=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:35.956629 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-d6b4423e-4796-45fc-bad7-a37ebeea515e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:14:35.960639 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-d6b4423e-4796-45fc-bad7-a37ebeea515e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for user f2f9826f53b44e1bbaf721d66de1356b and project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:14:35.988504 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d6b4423e-4796-45fc-bad7-a37ebeea515e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171947 Jun 28 12:14:35.989268 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 448/916] 10.222.0.55 () {60 vars in 1158 bytes} [Tue Jun 28 12:14:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:37.294382 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1650309254", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ab7246a-96e7-4fc8-aac1-d967c789fbd7"}], "security_groups": [{"name": "tempest-securitygroup--950730189"}], "key_name": "tempest-keypair-1979653189", "user_data": "}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:37.301989 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:37.302641 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:37.414552 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] validate_networks() for [('7ab7246a-96e7-4fc8-aac1-d967c789fbd7', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:14:37.834661 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:14:37.835213 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:14:37.835669 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:14:37.836078 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:14:37.838681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:14:37.847973 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:37.848410 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:37.849228 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:37.849711 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:37.868222 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:14:37.872598 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for user f2f9826f53b44e1bbaf721d66de1356b and project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:14:37.884551 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:14:37.886868 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:14:37.934345 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c4a1d5e4-ef97-4752-9fb5-25325de80a74 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.644376 Jun 28 12:14:37.935164 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 469/917] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:14:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:14:37.945412 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-70d1b6df-b811-406d-bcae-f7cb30bedb95 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:37.946007 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-70d1b6df-b811-406d-bcae-f7cb30bedb95 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:37.948717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:37.949854 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:38.073559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-70d1b6df-b811-406d-bcae-f7cb30bedb95 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:38.081725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-70d1b6df-b811-406d-bcae-f7cb30bedb95 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1242 microversion: 2.1 time: 0.139827 Jun 28 12:14:38.082455 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 449/918] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:37 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:39.099402 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-17accc6c-c96e-4eff-b70d-665e9e8ce57a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:39.100151 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-17accc6c-c96e-4eff-b70d-665e9e8ce57a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:39.107973 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-17accc6c-c96e-4eff-b70d-665e9e8ce57a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:39.108454 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-17accc6c-c96e-4eff-b70d-665e9e8ce57a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:39.109268 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-17accc6c-c96e-4eff-b70d-665e9e8ce57a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:39.109671 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-17accc6c-c96e-4eff-b70d-665e9e8ce57a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:39.173938 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-17accc6c-c96e-4eff-b70d-665e9e8ce57a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:39.181767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-17accc6c-c96e-4eff-b70d-665e9e8ce57a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1294 microversion: 2.1 time: 0.087119 Jun 28 12:14:39.182330 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 470/919] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:39 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:40.199131 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-98f2b16a-4c47-4991-81f2-afa7071eaabf tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:40.200501 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-98f2b16a-4c47-4991-81f2-afa7071eaabf tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:40.208240 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-98f2b16a-4c47-4991-81f2-afa7071eaabf tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:40.208720 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-98f2b16a-4c47-4991-81f2-afa7071eaabf tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:40.209722 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-98f2b16a-4c47-4991-81f2-afa7071eaabf tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:40.210178 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-98f2b16a-4c47-4991-81f2-afa7071eaabf tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:40.360855 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-98f2b16a-4c47-4991-81f2-afa7071eaabf tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:40.368984 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-98f2b16a-4c47-4991-81f2-afa7071eaabf tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.173879 Jun 28 12:14:40.369780 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 450/920] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:40 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:40.952194 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-aa423adf-da94-44c6-a36e-c2acffe803e4 req-97302e66-00ee-42a6-9dbf-5f9eeddc7024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023a3ea3-0028-4022-9f3f-0617a2b29e26", "tag": "95067e1f-36da-4d0e-ae1b-39e3c455020d"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:40.962437 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-aa423adf-da94-44c6-a36e-c2acffe803e4 req-97302e66-00ee-42a6-9dbf-5f9eeddc7024 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:40.963013 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-aa423adf-da94-44c6-a36e-c2acffe803e4 req-97302e66-00ee-42a6-9dbf-5f9eeddc7024 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:40.979305 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-aa423adf-da94-44c6-a36e-c2acffe803e4 req-97302e66-00ee-42a6-9dbf-5f9eeddc7024 service nova] Creating event network-changed:95067e1f-36da-4d0e-ae1b-39e3c455020d for instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 on hv-cinder-84795 Jun 28 12:14:40.984205 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-aa423adf-da94-44c6-a36e-c2acffe803e4 req-97302e66-00ee-42a6-9dbf-5f9eeddc7024 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036004 Jun 28 12:14:40.984733 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 471/921] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:41.390106 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-82661638-017c-4363-84fb-b46760297205 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:41.391069 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-82661638-017c-4363-84fb-b46760297205 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:41.400327 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82661638-017c-4363-84fb-b46760297205 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:41.400781 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82661638-017c-4363-84fb-b46760297205 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:41.401612 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82661638-017c-4363-84fb-b46760297205 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:41.402053 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82661638-017c-4363-84fb-b46760297205 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:41.544420 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-82661638-017c-4363-84fb-b46760297205 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:41.556135 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-82661638-017c-4363-84fb-b46760297205 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.172576 Jun 28 12:14:41.556680 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 451/922] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:41 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:42.045538 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:14:42.045829 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Tue Jun 28 12:14:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:14:42.579361 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-aafd38a3-72b0-4601-a762-8f91fea5aad1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:42.580526 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-aafd38a3-72b0-4601-a762-8f91fea5aad1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:42.592255 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aafd38a3-72b0-4601-a762-8f91fea5aad1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:42.593052 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aafd38a3-72b0-4601-a762-8f91fea5aad1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:42.594312 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aafd38a3-72b0-4601-a762-8f91fea5aad1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:42.595037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-aafd38a3-72b0-4601-a762-8f91fea5aad1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:42.733730 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-aafd38a3-72b0-4601-a762-8f91fea5aad1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:42.741901 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-aafd38a3-72b0-4601-a762-8f91fea5aad1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.170606 Jun 28 12:14:42.742715 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 472/923] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:42 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:43.764147 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5af85b15-f7d3-411f-8dbd-3ba35832c44f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:43.765844 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5af85b15-f7d3-411f-8dbd-3ba35832c44f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:43.775576 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5af85b15-f7d3-411f-8dbd-3ba35832c44f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:43.776033 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5af85b15-f7d3-411f-8dbd-3ba35832c44f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:43.776829 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5af85b15-f7d3-411f-8dbd-3ba35832c44f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:43.778439 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5af85b15-f7d3-411f-8dbd-3ba35832c44f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:43.925209 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5af85b15-f7d3-411f-8dbd-3ba35832c44f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:43.936044 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5af85b15-f7d3-411f-8dbd-3ba35832c44f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.178469 Jun 28 12:14:43.936841 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 452/924] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:43 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:44.960480 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-788a58a3-7236-4e7c-ba1f-9f6c854542a3 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:44.961226 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-788a58a3-7236-4e7c-ba1f-9f6c854542a3 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:44.968934 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-788a58a3-7236-4e7c-ba1f-9f6c854542a3 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:44.969445 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-788a58a3-7236-4e7c-ba1f-9f6c854542a3 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:44.970219 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-788a58a3-7236-4e7c-ba1f-9f6c854542a3 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:44.970657 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-788a58a3-7236-4e7c-ba1f-9f6c854542a3 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:45.258306 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-788a58a3-7236-4e7c-ba1f-9f6c854542a3 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:45.266251 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-788a58a3-7236-4e7c-ba1f-9f6c854542a3 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.310662 Jun 28 12:14:45.266743 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 473/925] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:44 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:46.283719 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d712efcd-b41c-4801-b08c-1dbcc61c0fcb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:46.284319 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d712efcd-b41c-4801-b08c-1dbcc61c0fcb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:46.291832 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d712efcd-b41c-4801-b08c-1dbcc61c0fcb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:46.292305 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d712efcd-b41c-4801-b08c-1dbcc61c0fcb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:46.293112 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d712efcd-b41c-4801-b08c-1dbcc61c0fcb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:46.293559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d712efcd-b41c-4801-b08c-1dbcc61c0fcb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:46.439387 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d712efcd-b41c-4801-b08c-1dbcc61c0fcb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:46.448120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d712efcd-b41c-4801-b08c-1dbcc61c0fcb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.168393 Jun 28 12:14:46.448694 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 453/926] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:46 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:47.470267 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d4be77f1-e641-4a98-bbc4-26c26b5f4798 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:47.471354 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d4be77f1-e641-4a98-bbc4-26c26b5f4798 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:47.482287 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4be77f1-e641-4a98-bbc4-26c26b5f4798 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:47.483044 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4be77f1-e641-4a98-bbc4-26c26b5f4798 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:47.484291 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4be77f1-e641-4a98-bbc4-26c26b5f4798 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:47.485064 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4be77f1-e641-4a98-bbc4-26c26b5f4798 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:47.629275 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d4be77f1-e641-4a98-bbc4-26c26b5f4798 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:47.637102 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d4be77f1-e641-4a98-bbc4-26c26b5f4798 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.173548 Jun 28 12:14:47.637657 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 474/927] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:47 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:48.654504 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7202290b-b93b-4d11-8cc4-a8b4365e17c4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:48.655112 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7202290b-b93b-4d11-8cc4-a8b4365e17c4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:48.657443 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:48.663270 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7202290b-b93b-4d11-8cc4-a8b4365e17c4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:48.663730 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7202290b-b93b-4d11-8cc4-a8b4365e17c4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:48.664492 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7202290b-b93b-4d11-8cc4-a8b4365e17c4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:48.664935 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7202290b-b93b-4d11-8cc4-a8b4365e17c4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:48.803011 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7202290b-b93b-4d11-8cc4-a8b4365e17c4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:48.811748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7202290b-b93b-4d11-8cc4-a8b4365e17c4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.161579 Jun 28 12:14:48.812330 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 454/928] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:48 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:49.217554 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a810fd65-5b4f-4b86-be01-84121e8413f2 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:49.218106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a810fd65-5b4f-4b86-be01-84121e8413f2 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:49.220027 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:49.220682 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:49.227061 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a810fd65-5b4f-4b86-be01-84121e8413f2 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:49.227507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a810fd65-5b4f-4b86-be01-84121e8413f2 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:49.228297 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a810fd65-5b4f-4b86-be01-84121e8413f2 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:49.228874 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a810fd65-5b4f-4b86-be01-84121e8413f2 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:49.312369 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-a810fd65-5b4f-4b86-be01-84121e8413f2 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lazy-loading 'services' on Instance uuid 8eb44fc7-6cbc-419a-90a2-ddcba6661c49 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:14:49.386005 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a810fd65-5b4f-4b86-be01-84121e8413f2 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49/os-volume_attachments/166a9641-7db8-4228-8840-e4d2b5851ecc" status: 202 len: 0 microversion: 2.1 time: 0.171643 Jun 28 12:14:49.386626 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 475/929] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:14:49 2022] DELETE /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49/os-volume_attachments/166a9641-7db8-4228-8840-e4d2b5851ecc => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:14:49.829121 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-aecbe5e9-b6bb-448d-bcdf-c235a05b1254 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:49.829732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-aecbe5e9-b6bb-448d-bcdf-c235a05b1254 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:49.837226 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aecbe5e9-b6bb-448d-bcdf-c235a05b1254 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:49.837680 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aecbe5e9-b6bb-448d-bcdf-c235a05b1254 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:49.838672 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aecbe5e9-b6bb-448d-bcdf-c235a05b1254 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:49.839139 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aecbe5e9-b6bb-448d-bcdf-c235a05b1254 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:49.982328 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-aecbe5e9-b6bb-448d-bcdf-c235a05b1254 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:49.990472 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-aecbe5e9-b6bb-448d-bcdf-c235a05b1254 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.165344 Jun 28 12:14:49.991018 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 455/930] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:49 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:51.005809 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-a9ed4c43-d17a-4630-808b-0466336785fc req-21d6df54-524d-4757-b95b-5c6338038fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023a3ea3-0028-4022-9f3f-0617a2b29e26", "name": "network-vif-plugged", "status": "completed", "tag": "95067e1f-36da-4d0e-ae1b-39e3c455020d"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:51.011304 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e3ffd911-b0d2-49a6-83c3-903919df09d9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:51.012531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e3ffd911-b0d2-49a6-83c3-903919df09d9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:51.023615 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3ffd911-b0d2-49a6-83c3-903919df09d9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:51.024647 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3ffd911-b0d2-49a6-83c3-903919df09d9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:51.024886 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a9ed4c43-d17a-4630-808b-0466336785fc req-21d6df54-524d-4757-b95b-5c6338038fb2 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:51.025894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-a9ed4c43-d17a-4630-808b-0466336785fc req-21d6df54-524d-4757-b95b-5c6338038fb2 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:51.026533 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3ffd911-b0d2-49a6-83c3-903919df09d9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:51.027505 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3ffd911-b0d2-49a6-83c3-903919df09d9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:51.051967 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-a9ed4c43-d17a-4630-808b-0466336785fc req-21d6df54-524d-4757-b95b-5c6338038fb2 service nova] Creating event network-vif-plugged:95067e1f-36da-4d0e-ae1b-39e3c455020d for instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 on hv-cinder-84795 Jun 28 12:14:51.060945 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-a9ed4c43-d17a-4630-808b-0466336785fc req-21d6df54-524d-4757-b95b-5c6338038fb2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062218 Jun 28 12:14:51.062658 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 476/931] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:51.180957 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e3ffd911-b0d2-49a6-83c3-903919df09d9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:51.189459 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e3ffd911-b0d2-49a6-83c3-903919df09d9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.186036 Jun 28 12:14:51.190024 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 456/932] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:51 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:14:51.583420 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cf2d1b08-9b16-4f3e-bf99-3d6a0ab2b0e6 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:51.584009 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cf2d1b08-9b16-4f3e-bf99-3d6a0ab2b0e6 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:51.591266 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf2d1b08-9b16-4f3e-bf99-3d6a0ab2b0e6 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:51.591706 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf2d1b08-9b16-4f3e-bf99-3d6a0ab2b0e6 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:51.592488 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf2d1b08-9b16-4f3e-bf99-3d6a0ab2b0e6 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:51.592946 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf2d1b08-9b16-4f3e-bf99-3d6a0ab2b0e6 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:51.617987 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cf2d1b08-9b16-4f3e-bf99-3d6a0ab2b0e6 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:14:51.700374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cf2d1b08-9b16-4f3e-bf99-3d6a0ab2b0e6 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 204 len: 0 microversion: 2.1 time: 0.121373 Jun 28 12:14:51.700972 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 477/933] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:14:51 2022] DELETE /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:14:51.709685 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d2ecf71b-9fe6-4d07-9ec7-443e7cb46cc8 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:51.710329 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d2ecf71b-9fe6-4d07-9ec7-443e7cb46cc8 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:51.716478 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2ecf71b-9fe6-4d07-9ec7-443e7cb46cc8 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:51.716963 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2ecf71b-9fe6-4d07-9ec7-443e7cb46cc8 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:51.717733 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2ecf71b-9fe6-4d07-9ec7-443e7cb46cc8 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:51.718178 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2ecf71b-9fe6-4d07-9ec7-443e7cb46cc8 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:51.859875 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2ecf71b-9fe6-4d07-9ec7-443e7cb46cc8 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:51.867778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d2ecf71b-9fe6-4d07-9ec7-443e7cb46cc8 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1514 microversion: 2.1 time: 0.162426 Jun 28 12:14:51.868342 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 457/934] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:51 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:52.211388 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fd6aa078-6db1-4be9-9b28-bfe1f5853e10 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:52.212437 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fd6aa078-6db1-4be9-9b28-bfe1f5853e10 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:52.223963 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd6aa078-6db1-4be9-9b28-bfe1f5853e10 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:52.224723 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd6aa078-6db1-4be9-9b28-bfe1f5853e10 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:52.226045 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd6aa078-6db1-4be9-9b28-bfe1f5853e10 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:52.226776 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fd6aa078-6db1-4be9-9b28-bfe1f5853e10 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:52.372233 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fd6aa078-6db1-4be9-9b28-bfe1f5853e10 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:52.387017 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fd6aa078-6db1-4be9-9b28-bfe1f5853e10 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.182921 Jun 28 12:14:52.387563 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 478/935] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:52 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:52.890636 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-20935e74-b96a-4b1a-8cbf-9a864e089e81 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:52.891570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-20935e74-b96a-4b1a-8cbf-9a864e089e81 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:52.901741 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20935e74-b96a-4b1a-8cbf-9a864e089e81 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:52.902329 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20935e74-b96a-4b1a-8cbf-9a864e089e81 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:52.903117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20935e74-b96a-4b1a-8cbf-9a864e089e81 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:52.903554 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-20935e74-b96a-4b1a-8cbf-9a864e089e81 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:53.060388 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-20935e74-b96a-4b1a-8cbf-9a864e089e81 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:53.072148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-20935e74-b96a-4b1a-8cbf-9a864e089e81 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1514 microversion: 2.1 time: 0.189361 Jun 28 12:14:53.072924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 458/936] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:52 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:53.405191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f1342eda-3062-49b3-a130-5d0ae900bbc1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:53.405983 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f1342eda-3062-49b3-a130-5d0ae900bbc1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:53.412834 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1342eda-3062-49b3-a130-5d0ae900bbc1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:53.413319 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1342eda-3062-49b3-a130-5d0ae900bbc1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:53.414102 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1342eda-3062-49b3-a130-5d0ae900bbc1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:53.414535 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f1342eda-3062-49b3-a130-5d0ae900bbc1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:53.560940 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-f1342eda-3062-49b3-a130-5d0ae900bbc1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:53.568476 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f1342eda-3062-49b3-a130-5d0ae900bbc1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.167639 Jun 28 12:14:53.569028 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 479/937] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:53 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:54.096091 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a331fac4-1516-4a3e-a1e5-9a5e342b5d7f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:54.096977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a331fac4-1516-4a3e-a1e5-9a5e342b5d7f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:54.108613 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a331fac4-1516-4a3e-a1e5-9a5e342b5d7f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:54.110879 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a331fac4-1516-4a3e-a1e5-9a5e342b5d7f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:54.112276 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a331fac4-1516-4a3e-a1e5-9a5e342b5d7f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:54.113011 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a331fac4-1516-4a3e-a1e5-9a5e342b5d7f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:54.247647 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a331fac4-1516-4a3e-a1e5-9a5e342b5d7f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:54.258471 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a331fac4-1516-4a3e-a1e5-9a5e342b5d7f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1514 microversion: 2.1 time: 0.168613 Jun 28 12:14:54.259299 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 459/938] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:54 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:54.585421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cf6f4b14-be37-4b05-b0c8-325139d31466 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:54.586021 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cf6f4b14-be37-4b05-b0c8-325139d31466 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:54.593277 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf6f4b14-be37-4b05-b0c8-325139d31466 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:54.593736 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf6f4b14-be37-4b05-b0c8-325139d31466 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:54.594505 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf6f4b14-be37-4b05-b0c8-325139d31466 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:54.594941 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cf6f4b14-be37-4b05-b0c8-325139d31466 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:54.802119 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cf6f4b14-be37-4b05-b0c8-325139d31466 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:54.810163 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cf6f4b14-be37-4b05-b0c8-325139d31466 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1367 microversion: 2.1 time: 0.229057 Jun 28 12:14:54.819338 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 480/939] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:54 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:55.035899 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-d092b580-af53-45c6-872e-2f261fbcc2cd req-96af0190-bfeb-4b41-977a-0ce79e6a2684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb44fc7-6cbc-419a-90a2-ddcba6661c49", "name": "network-vif-deleted", "tag": "9ba54c71-9057-40b7-b7a5-c44d43748076"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:55.044463 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d092b580-af53-45c6-872e-2f261fbcc2cd req-96af0190-bfeb-4b41-977a-0ce79e6a2684 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:55.044943 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d092b580-af53-45c6-872e-2f261fbcc2cd req-96af0190-bfeb-4b41-977a-0ce79e6a2684 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:55.056213 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-d092b580-af53-45c6-872e-2f261fbcc2cd req-96af0190-bfeb-4b41-977a-0ce79e6a2684 service nova] Creating event network-vif-deleted:9ba54c71-9057-40b7-b7a5-c44d43748076 for instance 8eb44fc7-6cbc-419a-90a2-ddcba6661c49 on hv-cinder-84795 Jun 28 12:14:55.061677 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-d092b580-af53-45c6-872e-2f261fbcc2cd req-96af0190-bfeb-4b41-977a-0ce79e6a2684 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029629 Jun 28 12:14:55.062222 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 460/940] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:55.275881 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c0272973-e357-468f-9bdb-e84891cf3706 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:55.276481 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c0272973-e357-468f-9bdb-e84891cf3706 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:55.283164 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0272973-e357-468f-9bdb-e84891cf3706 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:55.283606 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0272973-e357-468f-9bdb-e84891cf3706 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:55.284357 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0272973-e357-468f-9bdb-e84891cf3706 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:55.284781 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c0272973-e357-468f-9bdb-e84891cf3706 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:55.346925 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c0272973-e357-468f-9bdb-e84891cf3706 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb9e04ba5c046398965b7e79eb3280b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac1aab84e994f7892964ff85819002d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:55.355152 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c0272973-e357-468f-9bdb-e84891cf3706 tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 200 len: 1303 microversion: 2.1 time: 0.083143 Jun 28 12:14:55.355810 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 481/941] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:55 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 1303 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:55.827102 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-03d2fef5-c891-4155-9726-4a58f3daede0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:55.827801 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-03d2fef5-c891-4155-9726-4a58f3daede0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:55.835437 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-03d2fef5-c891-4155-9726-4a58f3daede0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:55.835881 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-03d2fef5-c891-4155-9726-4a58f3daede0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:55.836656 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-03d2fef5-c891-4155-9726-4a58f3daede0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:55.837172 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-03d2fef5-c891-4155-9726-4a58f3daede0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:55.971388 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-03d2fef5-c891-4155-9726-4a58f3daede0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:14:55.979407 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-03d2fef5-c891-4155-9726-4a58f3daede0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1557 microversion: 2.1 time: 0.156476 Jun 28 12:14:55.980291 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 461/942] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:55 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:14:55.996308 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-22e72dc9-3e78-49cd-9275-4ecac3a9445e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:55.996823 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-22e72dc9-3e78-49cd-9275-4ecac3a9445e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:56.003412 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-22e72dc9-3e78-49cd-9275-4ecac3a9445e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:56.003858 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-22e72dc9-3e78-49cd-9275-4ecac3a9445e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:56.004649 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-22e72dc9-3e78-49cd-9275-4ecac3a9445e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:56.005114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-22e72dc9-3e78-49cd-9275-4ecac3a9445e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:56.087320 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-22e72dc9-3e78-49cd-9275-4ecac3a9445e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094802 Jun 28 12:14:56.088258 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 482/943] 10.222.0.55 () {58 vars in 1274 bytes} [Tue Jun 28 12:14:55 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:14:56.373188 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ef6bd533-b8b6-46be-a3be-81df1d049a1f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:14:56.373805 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ef6bd533-b8b6-46be-a3be-81df1d049a1f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] [instance: 8eb44fc7-6cbc-419a-90a2-ddcba6661c49] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:14:56.380356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef6bd533-b8b6-46be-a3be-81df1d049a1f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:56.380809 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef6bd533-b8b6-46be-a3be-81df1d049a1f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:56.381605 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef6bd533-b8b6-46be-a3be-81df1d049a1f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:56.382042 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef6bd533-b8b6-46be-a3be-81df1d049a1f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:56.396254 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-ef6bd533-b8b6-46be-a3be-81df1d049a1f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] HTTP exception thrown: Instance 8eb44fc7-6cbc-419a-90a2-ddcba6661c49 could not be found. Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ef6bd533-b8b6-46be-a3be-81df1d049a1f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Request method failure captured: Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 HTTP/1.1 Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuvAtbfIFxaNxZxBr4peOXVXPmUqEra7fwQmTkS1CzhGG5bB1O4kzUOHRhlhkrOmiaYa6IIp_EQugmmyS3CPq73pX4cHRX8iNRoS8lbYG5D21GxmZX2XPI8qxx8f2ozOpdWr_2FQI-qjwztRrNffKBdaItGTLcGqjkSJ5Ts6AV_Hwx0M Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 2ac1aab84e994f7892964ff85819002d Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2031561607 Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:14:56.398300 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2ac1aab84e994f7892964ff85819002d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2ac1aab84e994f7892964ff85819002d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2ac1aab84e994f7892964ff85819002d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2ac1aab84e994f7892964ff85819002d"}]}] Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesSnapshotTestJSON-2031561607 Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 2ac1aab84e994f7892964ff85819002d Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2031561607 Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesSnapshotTestJSON-2031561607-project Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: ddb9e04ba5c046398965b7e79eb3280b Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesSnapshotTestJSON-2031561607-project Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 8eb44fc7-6cbc-419a-90a2-ddcba6661c49 could not be found. Jun 28 12:14:56.400450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '8eb44fc7-6cbc-419a-90a2-ddcba6661c49'} Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb44fc7-6cbc-419a-90a2-ddcba6661c49 could not be found. Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:14:56.401422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb44fc7-6cbc-419a-90a2-ddcba6661c49 could not be found. Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb44fc7-6cbc-419a-90a2-ddcba6661c49 could not be found. Jun 28 12:14:56.403176 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:14:56.405833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ef6bd533-b8b6-46be-a3be-81df1d049a1f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] Returning 404 to user: Instance 8eb44fc7-6cbc-419a-90a2-ddcba6661c49 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:14:56.405833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ef6bd533-b8b6-46be-a3be-81df1d049a1f tempest-VolumesSnapshotTestJSON-2031561607 tempest-VolumesSnapshotTestJSON-2031561607-project] 10.222.0.55 "GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49" status: 404 len: 111 microversion: 2.1 time: 0.030801 Jun 28 12:14:56.405833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 462/944] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:14:56 2022] GET /compute/v2.1/servers/8eb44fc7-6cbc-419a-90a2-ddcba6661c49 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:14:57.076790 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-4c74a90c-5896-4cd3-b0a6-dc6ba9255271 req-83d335f6-377b-4f40-ad4a-31360f5d7791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023a3ea3-0028-4022-9f3f-0617a2b29e26", "tag": "95067e1f-36da-4d0e-ae1b-39e3c455020d"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:14:57.085732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-4c74a90c-5896-4cd3-b0a6-dc6ba9255271 req-83d335f6-377b-4f40-ad4a-31360f5d7791 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:14:57.086169 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-4c74a90c-5896-4cd3-b0a6-dc6ba9255271 req-83d335f6-377b-4f40-ad4a-31360f5d7791 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:14:57.097564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-4c74a90c-5896-4cd3-b0a6-dc6ba9255271 req-83d335f6-377b-4f40-ad4a-31360f5d7791 service nova] Creating event network-changed:95067e1f-36da-4d0e-ae1b-39e3c455020d for instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 on hv-cinder-84795 Jun 28 12:14:57.103251 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-4c74a90c-5896-4cd3-b0a6-dc6ba9255271 req-83d335f6-377b-4f40-ad4a-31360f5d7791 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030665 Jun 28 12:14:57.103845 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 483/945] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:15:05.211231 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d5d17925-058a-4d29-8689-57b5a38dd59d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:05.212164 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d5d17925-058a-4d29-8689-57b5a38dd59d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:05.218994 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5d17925-058a-4d29-8689-57b5a38dd59d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:05.219408 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5d17925-058a-4d29-8689-57b5a38dd59d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:05.220175 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5d17925-058a-4d29-8689-57b5a38dd59d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:05.220613 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d5d17925-058a-4d29-8689-57b5a38dd59d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:05.252685 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d5d17925-058a-4d29-8689-57b5a38dd59d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045628 Jun 28 12:15:05.253308 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 463/946] 10.222.0.55 () {60 vars in 1342 bytes} [Tue Jun 28 12:15:05 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:15:05.315006 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-f642a2f4-641e-4b82-b9e2-e921e7e03ad5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:05.315619 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f642a2f4-641e-4b82-b9e2-e921e7e03ad5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:05.321995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f642a2f4-641e-4b82-b9e2-e921e7e03ad5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:05.322450 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f642a2f4-641e-4b82-b9e2-e921e7e03ad5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:05.323221 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f642a2f4-641e-4b82-b9e2-e921e7e03ad5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:05.323648 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-f642a2f4-641e-4b82-b9e2-e921e7e03ad5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:05.349413 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-f642a2f4-641e-4b82-b9e2-e921e7e03ad5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:15:05.395679 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:05.429127 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-f642a2f4-641e-4b82-b9e2-e921e7e03ad5 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 204 len: 0 microversion: 2.20 time: 0.118876 Jun 28 12:15:05.429709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 484/947] 10.222.0.55 () {60 vars in 1279 bytes} [Tue Jun 28 12:15:05 2022] DELETE /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 28 12:15:05.439125 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eedaedea-8559-44c3-af4f-9eb521e2aef8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:05.439767 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eedaedea-8559-44c3-af4f-9eb521e2aef8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:05.446689 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eedaedea-8559-44c3-af4f-9eb521e2aef8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:05.446983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eedaedea-8559-44c3-af4f-9eb521e2aef8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:05.447756 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eedaedea-8559-44c3-af4f-9eb521e2aef8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:05.448194 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eedaedea-8559-44c3-af4f-9eb521e2aef8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:05.585526 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eedaedea-8559-44c3-af4f-9eb521e2aef8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:05.596855 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eedaedea-8559-44c3-af4f-9eb521e2aef8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:05.598858 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eedaedea-8559-44c3-af4f-9eb521e2aef8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:05.600037 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eedaedea-8559-44c3-af4f-9eb521e2aef8 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.165335 Jun 28 12:15:05.601747 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 464/948] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:15:05 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:15:06.626788 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d869f77b-2db1-41bc-8704-ef9038906325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:06.627997 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d869f77b-2db1-41bc-8704-ef9038906325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:06.637003 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d869f77b-2db1-41bc-8704-ef9038906325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:06.637470 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d869f77b-2db1-41bc-8704-ef9038906325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:06.638213 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d869f77b-2db1-41bc-8704-ef9038906325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:06.638870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d869f77b-2db1-41bc-8704-ef9038906325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:06.777072 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d869f77b-2db1-41bc-8704-ef9038906325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:06.785666 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d869f77b-2db1-41bc-8704-ef9038906325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:06.787169 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d869f77b-2db1-41bc-8704-ef9038906325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:06.788574 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d869f77b-2db1-41bc-8704-ef9038906325 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.169698 Jun 28 12:15:06.789164 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 485/949] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:15:06 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:15:07.806430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dbedb716-cf2a-4f61-85dd-0914ea0cc9a1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:07.807024 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dbedb716-cf2a-4f61-85dd-0914ea0cc9a1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:07.814692 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbedb716-cf2a-4f61-85dd-0914ea0cc9a1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:07.815151 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbedb716-cf2a-4f61-85dd-0914ea0cc9a1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:07.816551 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbedb716-cf2a-4f61-85dd-0914ea0cc9a1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:07.817099 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dbedb716-cf2a-4f61-85dd-0914ea0cc9a1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:07.952832 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dbedb716-cf2a-4f61-85dd-0914ea0cc9a1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:07.961256 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dbedb716-cf2a-4f61-85dd-0914ea0cc9a1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:07.962756 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dbedb716-cf2a-4f61-85dd-0914ea0cc9a1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:07.963968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dbedb716-cf2a-4f61-85dd-0914ea0cc9a1 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1722 microversion: 2.20 time: 0.161554 Jun 28 12:15:07.964802 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 465/950] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:15:07 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 12:15:08.630500 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-f22404a9-71de-4125-b4b9-746f6e693551 req-77b083b4-3259-43eb-b5b6-aadf6024ddb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905", "name": "network-vif-deleted", "tag": "0facb1bd-c05b-4bcb-b042-f7de35787204"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:15:08.634933 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:08.641220 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-f22404a9-71de-4125-b4b9-746f6e693551 req-77b083b4-3259-43eb-b5b6-aadf6024ddb4 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:08.641844 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-f22404a9-71de-4125-b4b9-746f6e693551 req-77b083b4-3259-43eb-b5b6-aadf6024ddb4 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:08.655631 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-f22404a9-71de-4125-b4b9-746f6e693551 req-77b083b4-3259-43eb-b5b6-aadf6024ddb4 service nova] Creating event network-vif-deleted:0facb1bd-c05b-4bcb-b042-f7de35787204 for instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 on hv-cinder-84795 Jun 28 12:15:08.661001 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-f22404a9-71de-4125-b4b9-746f6e693551 req-77b083b4-3259-43eb-b5b6-aadf6024ddb4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110187 Jun 28 12:15:08.664481 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 486/951] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:15:08.982841 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:08.983420 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:08.985727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=36 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:08.990883 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:08.991331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:08.992091 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:08.992525 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:08.995486 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=89 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:09.027590 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:09.027944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:09.028392 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lazy-loading 'fault' on Instance uuid 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:15:09.072002 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:09.080892 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:09.082576 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:09.083747 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ce0dd2af-3705-414f-a9dc-3b6988e1ef37 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1371 microversion: 2.20 time: 0.105108 Jun 28 12:15:09.084298 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 466/952] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:15:08 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:15:10.108438 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:10.109129 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:10.115901 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:10.116344 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:10.117128 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:10.117574 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:10.152120 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:10.152561 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:10.153037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lazy-loading 'fault' on Instance uuid 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:15:10.199483 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:10.210658 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:10.212435 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:10.213671 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-19866b33-104b-4e52-95bd-9d5fd79bd54e tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1371 microversion: 2.20 time: 0.113283 Jun 28 12:15:10.214198 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 487/953] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:15:10 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:15:11.237543 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:11.238447 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:11.249218 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:11.249673 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:11.250563 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:11.251006 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:11.283199 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:11.283649 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:11.284093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lazy-loading 'fault' on Instance uuid 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:15:11.325391 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:11.334237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:11.335731 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:11.336880 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e6288840-c10a-4bea-9fde-293f3323826c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1371 microversion: 2.20 time: 0.106402 Jun 28 12:15:11.337442 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 467/954] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:15:11 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:15:12.356287 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:12.356977 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:12.364097 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:12.364547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:12.365349 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:12.365785 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:12.397190 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:12.397633 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:12.398084 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lazy-loading 'fault' on Instance uuid 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:15:12.444115 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:12.452477 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:12.453996 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '702dcd49668c4680b5bf3c1c75575ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb27799cde2e4258a2eedc5bda555c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:15:12.455165 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5516561f-4580-4f40-b4e4-1e476156ad42 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 200 len: 1371 microversion: 2.20 time: 0.103505 Jun 28 12:15:12.456092 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 488/955] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:15:12 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 12:15:13.479851 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0c442ab4-89a5-443f-ae80-920497a9affb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:13.480498 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0c442ab4-89a5-443f-ae80-920497a9affb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:13.488046 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c442ab4-89a5-443f-ae80-920497a9affb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:13.488534 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c442ab4-89a5-443f-ae80-920497a9affb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:13.489341 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c442ab4-89a5-443f-ae80-920497a9affb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:13.489789 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c442ab4-89a5-443f-ae80-920497a9affb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:13.504770 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-0c442ab4-89a5-443f-ae80-920497a9affb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] HTTP exception thrown: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0c442ab4-89a5-443f-ae80-920497a9affb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Request method failure captured: Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 HTTP/1.1 Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu5VPs3zIsq_7F49XLI1p5lweATsiT4C-aWMMe-K9M_SizQv98XbrP44yVFIqXI7PZRVq6eu7tRJJDN4fayDF4odSde-PU-cmf0Q7CbfW4c5apeH86f9TJm6nNN1o-PAssHbBOLpGzsAB9XMXWAz0xkKfA9tyHxJpHmtWd4yaijB3MY Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:15:13.506356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}] Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: 702dcd49668c4680b5bf3c1c75575ab7 Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:13.507967 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905'} Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:15:13.509117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:13.510630 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:13.512028 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0c442ab4-89a5-443f-ae80-920497a9affb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Returning 404 to user: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:15:13.512028 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0c442ab4-89a5-443f-ae80-920497a9affb tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 404 len: 111 microversion: 2.20 time: 0.032150 Jun 28 12:15:13.512028 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 468/956] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:15:13 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 12:15:13.517365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bafe0b5e-7e20-4705-8b03-7b3b0fb6c91f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '.version_select at 0x7f3932cf6d30>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:13.538376 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bafe0b5e-7e20-4705-8b03-7b3b0fb6c91f tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210689827" status: 204 len: 0 microversion: 2.20 time: 0.025431 Jun 28 12:15:13.538927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 489/957] 10.222.0.55 () {60 vars in 1261 bytes} [Tue Jun 28 12:15:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210689827 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 28 12:15:15.326414 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-214263af-9952-4f11-b75c-d8318df43604 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:15.327018 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-214263af-9952-4f11-b75c-d8318df43604 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:15.335463 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-214263af-9952-4f11-b75c-d8318df43604 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:15.335936 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-214263af-9952-4f11-b75c-d8318df43604 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:15.336699 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-214263af-9952-4f11-b75c-d8318df43604 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:15.337155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-214263af-9952-4f11-b75c-d8318df43604 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:15.350711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-214263af-9952-4f11-b75c-d8318df43604 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] HTTP exception thrown: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-214263af-9952-4f11-b75c-d8318df43604 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Request method failure captured: Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 HTTP/1.1 Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu5VPs3zIsq_7F49XLI1p5lweATsiT4C-aWMMe-K9M_SizQv98XbrP44yVFIqXI7PZRVq6eu7tRJJDN4fayDF4odSde-PU-cmf0Q7CbfW4c5apeH86f9TJm6nNN1o-PAssHbBOLpGzsAB9XMXWAz0xkKfA9tyHxJpHmtWd4yaijB3MY Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:15:15.352302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}] Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: 702dcd49668c4680b5bf3c1c75575ab7 Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:15.353977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905'} Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:15:15.354966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:15.356456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:15.358036 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-214263af-9952-4f11-b75c-d8318df43604 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Returning 404 to user: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:15:15.358036 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-214263af-9952-4f11-b75c-d8318df43604 tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 404 len: 111 microversion: 2.20 time: 0.032858 Jun 28 12:15:15.358036 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 469/958] 10.222.0.55 () {60 vars in 1279 bytes} [Tue Jun 28 12:15:15 2022] DELETE /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 12:15:15.365268 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c5b57545-3f7b-49a4-8b5d-794c3a3d809d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:15.366159 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c5b57545-3f7b-49a4-8b5d-794c3a3d809d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:15.377181 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5b57545-3f7b-49a4-8b5d-794c3a3d809d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:15.377916 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5b57545-3f7b-49a4-8b5d-794c3a3d809d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:15.379073 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5b57545-3f7b-49a4-8b5d-794c3a3d809d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:15.379756 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c5b57545-3f7b-49a4-8b5d-794c3a3d809d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:15.397919 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-c5b57545-3f7b-49a4-8b5d-794c3a3d809d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] HTTP exception thrown: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c5b57545-3f7b-49a4-8b5d-794c3a3d809d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Request method failure captured: Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 HTTP/1.1 Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5VPs3zIsq_7F49XLI1p5lweATsiT4C-aWMMe-K9M_SizQv98XbrP44yVFIqXI7PZRVq6eu7tRJJDN4fayDF4odSde-PU-cmf0Q7CbfW4c5apeH86f9TJm6nNN1o-PAssHbBOLpGzsAB9XMXWAz0xkKfA9tyHxJpHmtWd4yaijB3MY Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:15:15.399596 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}] Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 702dcd49668c4680b5bf3c1c75575ab7 Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:15.401970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905'} Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:15:15.402818 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. Jun 28 12:15:15.404110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:15:15.405561 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c5b57545-3f7b-49a4-8b5d-794c3a3d809d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Returning 404 to user: Instance 4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:15:15.405561 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c5b57545-3f7b-49a4-8b5d-794c3a3d809d tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905" status: 404 len: 111 microversion: 2.20 time: 0.042479 Jun 28 12:15:15.405561 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 490/959] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:15:15 2022] GET /compute/v2.1/servers/4a8ddd5d-2df2-4bef-9ee7-b7e0b2661905 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 12:15:16.553231 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c1bd5452-5c0a-4783-8142-8efe894e348c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:16.553810 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c1bd5452-5c0a-4783-8142-8efe894e348c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:16.560666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1bd5452-5c0a-4783-8142-8efe894e348c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:16.561160 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1bd5452-5c0a-4783-8142-8efe894e348c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:16.561925 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1bd5452-5c0a-4783-8142-8efe894e348c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:16.562428 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1bd5452-5c0a-4783-8142-8efe894e348c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:16.576116 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-c1bd5452-5c0a-4783-8142-8efe894e348c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] HTTP exception thrown: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c1bd5452-5c0a-4783-8142-8efe894e348c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Request method failure captured: Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d HTTP/1.1 Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu5VPs3zIsq_7F49XLI1p5lweATsiT4C-aWMMe-K9M_SizQv98XbrP44yVFIqXI7PZRVq6eu7tRJJDN4fayDF4odSde-PU-cmf0Q7CbfW4c5apeH86f9TJm6nNN1o-PAssHbBOLpGzsAB9XMXWAz0xkKfA9tyHxJpHmtWd4yaijB3MY Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:15:16.577748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}] Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: 702dcd49668c4680b5bf3c1c75575ab7 Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:15:16.579535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '350964d7-7d2a-4335-b45e-c50e8cd87f7d'} Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:15:16.580999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:15:16.582654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:15:16.584224 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c1bd5452-5c0a-4783-8142-8efe894e348c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Returning 404 to user: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:15:16.584224 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c1bd5452-5c0a-4783-8142-8efe894e348c tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "DELETE /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 404 len: 111 microversion: 2.20 time: 0.030070 Jun 28 12:15:16.584224 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 470/960] 10.222.0.55 () {60 vars in 1279 bytes} [Tue Jun 28 12:15:16 2022] DELETE /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 12:15:16.588493 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7bcc4049-473b-453f-b191-243aeaaceabe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:15:16.589016 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7bcc4049-473b-453f-b191-243aeaaceabe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] [instance: 350964d7-7d2a-4335-b45e-c50e8cd87f7d] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:15:16.595966 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bcc4049-473b-453f-b191-243aeaaceabe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:16.596413 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bcc4049-473b-453f-b191-243aeaaceabe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:16.597208 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bcc4049-473b-453f-b191-243aeaaceabe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:15:16.597707 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7bcc4049-473b-453f-b191-243aeaaceabe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:15:16.611273 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-7bcc4049-473b-453f-b191-243aeaaceabe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] HTTP exception thrown: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7bcc4049-473b-453f-b191-243aeaaceabe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Request method failure captured: Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d HTTP/1.1 Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu5VPs3zIsq_7F49XLI1p5lweATsiT4C-aWMMe-K9M_SizQv98XbrP44yVFIqXI7PZRVq6eu7tRJJDN4fayDF4odSde-PU-cmf0Q7CbfW4c5apeH86f9TJm6nNN1o-PAssHbBOLpGzsAB9XMXWAz0xkKfA9tyHxJpHmtWd4yaijB3MY Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:15:16.612806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_cb27799cde2e4258a2eedc5bda555c61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/cb27799cde2e4258a2eedc5bda555c61"}]}] Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: cb27799cde2e4258a2eedc5bda555c61 Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-633909158 Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 702dcd49668c4680b5bf3c1c75575ab7 Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeShelveTestJSON-633909158-project Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:15:16.614556 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '350964d7-7d2a-4335-b45e-c50e8cd87f7d'} Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:15:16.615374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. Jun 28 12:15:16.616602 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:15:16.617730 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7bcc4049-473b-453f-b191-243aeaaceabe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] Returning 404 to user: Instance 350964d7-7d2a-4335-b45e-c50e8cd87f7d could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:15:16.617730 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7bcc4049-473b-453f-b191-243aeaaceabe tempest-AttachVolumeShelveTestJSON-633909158 tempest-AttachVolumeShelveTestJSON-633909158-project] 10.222.0.55 "GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d" status: 404 len: 111 microversion: 2.20 time: 0.029900 Jun 28 12:15:16.617730 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 491/961] 10.222.0.55 () {60 vars in 1276 bytes} [Tue Jun 28 12:15:16 2022] GET /compute/v2.1/servers/350964d7-7d2a-4335-b45e-c50e8cd87f7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 12:15:36.369491 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=13 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:36.371008 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=21 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:36.642860 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f2ca9020-2086-4359-a707-b7768e971604 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Action: 'create', calling method: .version_select at 0x7f3932e54940>, body: {"keypair": {"name": "tempest-TestShelveInstance-493460915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQqoZFU8F2GduKKKa3zZggbCXzw4m7PEMzlB8y+D3n3nh/cSZfq9ePxJHw7pmBFQ1Gi8W+oxPX/1N8RSpT9r5rIz/HnnP9zfCk9+i+3xPMktWueuSBPlDbmT3e11mR1UQ=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:15:36.659214 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-f2ca9020-2086-4359-a707-b7768e971604 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Getting quotas for project 56f6e9f5c280479d9050a6bfdde0d68b. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:15:36.663588 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-f2ca9020-2086-4359-a707-b7768e971604 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Getting quotas for user 1c0c3b5771de4561835b6bb4a74c86ed and project 56f6e9f5c280479d9050a6bfdde0d68b. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:15:36.687696 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f2ca9020-2086-4359-a707-b7768e971604 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.324824 Jun 28 12:15:36.688312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 471/962] 10.222.0.55 () {60 vars in 1158 bytes} [Tue Jun 28 12:15:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:16:01.639104 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-684498942", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "networks": [{"uuid": "bddbb7e5-f537-435c-9947-5d2bad264218"}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:01.646188 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:01.646820 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:01.700368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] validate_networks() for [('bddbb7e5-f537-435c-9947-5d2bad264218', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:16:02.122961 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:16:02.123434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:16:02.123877 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:16:02.124320 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:16:02.124730 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:16:02.134420 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:02.134864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:02.135653 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:02.136096 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:02.154214 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Getting quotas for project 1affbea314ef42ae9c8eb051f633e3df. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:16:02.158645 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Getting quotas for user f0c23febe0064a6abddc75cae27e7ef4 and project 1affbea314ef42ae9c8eb051f633e3df. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:16:02.170459 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:16:02.172720 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:16:02.218761 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1e7bcaeb-3d4a-4aca-ace2-52cb6eea8507 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586117 Jun 28 12:16:02.219451 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 492/963] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:16:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:16:02.227068 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:02.228371 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:02.232843 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-237ff72a-2a07-4ac9-911d-8e9885991f7c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:02.233643 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-237ff72a-2a07-4ac9-911d-8e9885991f7c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:02.292325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-237ff72a-2a07-4ac9-911d-8e9885991f7c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:02.299379 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-237ff72a-2a07-4ac9-911d-8e9885991f7c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1213 microversion: 2.1 time: 0.073596 Jun 28 12:16:02.299942 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 472/964] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:02 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:02.573897 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1385483472", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-493460915", "security_groups": [{"name": "tempest-secgroup-smoke-1726148872"}], "networks": [{"uuid": "f83c0f1b-75af-4d7c-87e7-fa03c1664d61"}], "block_device_mapping_v2": [{"uuid": "bf3f468b-77a9-4e87-a289-5be059652e81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:02.694173 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] validate_networks() for [('f83c0f1b-75af-4d7c-87e7-fa03c1664d61', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:16:03.075649 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:16:03.076360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:16:03.076840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:16:03.077371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:16:03.077808 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:16:03.087255 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:03.087811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:03.088664 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:03.089125 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:03.105882 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Getting quotas for project 56f6e9f5c280479d9050a6bfdde0d68b. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:16:03.110078 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Getting quotas for user 1c0c3b5771de4561835b6bb4a74c86ed and project 56f6e9f5c280479d9050a6bfdde0d68b. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:16:03.168371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:16:03.176310 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf3f468b-77a9-4e87-a289-5be059652e81',volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:16:03.313516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e488e113-fa8d-472f-bb2d-b535d4e8bfea tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.743542 Jun 28 12:16:03.314429 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 493/965] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:16:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:16:03.317542 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-af0a0082-7bfd-4edc-a859-9f3bb8ec6d32 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:03.318290 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-af0a0082-7bfd-4edc-a859-9f3bb8ec6d32 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:03.324651 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-12403065-b443-4593-8218-09460b2e0736 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:03.325209 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-12403065-b443-4593-8218-09460b2e0736 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:03.327771 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af0a0082-7bfd-4edc-a859-9f3bb8ec6d32 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:03.328429 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af0a0082-7bfd-4edc-a859-9f3bb8ec6d32 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:03.329820 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af0a0082-7bfd-4edc-a859-9f3bb8ec6d32 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:03.331215 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af0a0082-7bfd-4edc-a859-9f3bb8ec6d32 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:03.381378 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-12403065-b443-4593-8218-09460b2e0736 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:03.388280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-12403065-b443-4593-8218-09460b2e0736 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1088 microversion: 2.1 time: 0.067551 Jun 28 12:16:03.390874 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 494/966] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:03 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:03.422251 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-af0a0082-7bfd-4edc-a859-9f3bb8ec6d32 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:03.430624 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-af0a0082-7bfd-4edc-a859-9f3bb8ec6d32 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1265 microversion: 2.1 time: 0.117290 Jun 28 12:16:03.440639 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 473/967] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:03 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:04.407007 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-76500b73-34a4-4c46-9ce2-4b073d74529a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:04.407634 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-76500b73-34a4-4c46-9ce2-4b073d74529a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:04.417073 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-76500b73-34a4-4c46-9ce2-4b073d74529a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:04.417790 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-76500b73-34a4-4c46-9ce2-4b073d74529a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:04.418731 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-76500b73-34a4-4c46-9ce2-4b073d74529a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:04.419319 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-76500b73-34a4-4c46-9ce2-4b073d74529a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:04.450428 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-180794d3-6810-4d70-b875-41f3e9ab4a64 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:04.451384 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-180794d3-6810-4d70-b875-41f3e9ab4a64 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:04.459012 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-180794d3-6810-4d70-b875-41f3e9ab4a64 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:04.459844 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-180794d3-6810-4d70-b875-41f3e9ab4a64 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:04.460654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-180794d3-6810-4d70-b875-41f3e9ab4a64 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:04.461278 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-180794d3-6810-4d70-b875-41f3e9ab4a64 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:04.552575 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-76500b73-34a4-4c46-9ce2-4b073d74529a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:04.561345 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-76500b73-34a4-4c46-9ce2-4b073d74529a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1194 microversion: 2.1 time: 0.157786 Jun 28 12:16:04.562441 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 495/968] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:04 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1194 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:04.618617 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-180794d3-6810-4d70-b875-41f3e9ab4a64 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:04.628553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-180794d3-6810-4d70-b875-41f3e9ab4a64 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1313 microversion: 2.1 time: 0.184728 Jun 28 12:16:04.629832 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 474/969] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:04 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:16:05.324486 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-fe3c0730-648f-4762-bc0c-1a18f6d5444f req-bdf7c06e-b5be-4371-93e5-a584cce206b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ebbbca-086e-4030-8fdc-29bf57e9b387", "tag": "75dec28a-9347-471b-8424-5d6c8781fa5a"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:05.335973 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-fe3c0730-648f-4762-bc0c-1a18f6d5444f req-bdf7c06e-b5be-4371-93e5-a584cce206b0 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:05.337000 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-fe3c0730-648f-4762-bc0c-1a18f6d5444f req-bdf7c06e-b5be-4371-93e5-a584cce206b0 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:05.349757 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-fe3c0730-648f-4762-bc0c-1a18f6d5444f req-bdf7c06e-b5be-4371-93e5-a584cce206b0 service nova] Creating event network-changed:75dec28a-9347-471b-8424-5d6c8781fa5a for instance 20ebbbca-086e-4030-8fdc-29bf57e9b387 on hv-cinder-84795 Jun 28 12:16:05.356234 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-fe3c0730-648f-4762-bc0c-1a18f6d5444f req-bdf7c06e-b5be-4371-93e5-a584cce206b0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037077 Jun 28 12:16:05.357660 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 496/970] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:05.578701 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3ab79855-8f9f-47b4-a557-4bfc4e777e65 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:05.579677 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3ab79855-8f9f-47b4-a557-4bfc4e777e65 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:05.586744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ab79855-8f9f-47b4-a557-4bfc4e777e65 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:05.587243 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ab79855-8f9f-47b4-a557-4bfc4e777e65 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:05.588067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ab79855-8f9f-47b4-a557-4bfc4e777e65 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:05.588524 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ab79855-8f9f-47b4-a557-4bfc4e777e65 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:05.647050 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a6598c95-bab3-4b5c-8315-581e15265e43 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:05.647787 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a6598c95-bab3-4b5c-8315-581e15265e43 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:05.657296 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6598c95-bab3-4b5c-8315-581e15265e43 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:05.657732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6598c95-bab3-4b5c-8315-581e15265e43 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:05.658775 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6598c95-bab3-4b5c-8315-581e15265e43 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:05.660088 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a6598c95-bab3-4b5c-8315-581e15265e43 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:05.738891 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3ab79855-8f9f-47b4-a557-4bfc4e777e65 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:05.747317 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3ab79855-8f9f-47b4-a557-4bfc4e777e65 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.172525 Jun 28 12:16:05.748273 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 475/971] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:05 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:06.215872 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a6598c95-bab3-4b5c-8315-581e15265e43 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:06.223689 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a6598c95-bab3-4b5c-8315-581e15265e43 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1313 microversion: 2.1 time: 0.580908 Jun 28 12:16:06.224629 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 497/972] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:05 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:16:06.765205 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7d3a9712-d088-41cf-9e20-8dd54a9c754e tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:06.771050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7d3a9712-d088-41cf-9e20-8dd54a9c754e tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:06.779595 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d3a9712-d088-41cf-9e20-8dd54a9c754e tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:06.780110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d3a9712-d088-41cf-9e20-8dd54a9c754e tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:06.780918 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d3a9712-d088-41cf-9e20-8dd54a9c754e tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:06.781772 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7d3a9712-d088-41cf-9e20-8dd54a9c754e tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:06.928075 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7d3a9712-d088-41cf-9e20-8dd54a9c754e tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:06.936607 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7d3a9712-d088-41cf-9e20-8dd54a9c754e tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.175848 Jun 28 12:16:06.937229 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 476/973] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:06 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:07.243560 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a3711881-3b05-4913-a80f-ebe04ed1b798 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:07.244318 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a3711881-3b05-4913-a80f-ebe04ed1b798 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:07.252302 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3711881-3b05-4913-a80f-ebe04ed1b798 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:07.252754 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3711881-3b05-4913-a80f-ebe04ed1b798 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:07.253550 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3711881-3b05-4913-a80f-ebe04ed1b798 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:07.253978 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a3711881-3b05-4913-a80f-ebe04ed1b798 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:07.380349 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-57a90118-3171-414d-b243-1ec8550bff2e req-5f04d41a-a2bd-4a1a-856c-3ef92dd5710d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3086f12b-7edc-4ff3-a17d-def512b5679a", "tag": "21fbb702-a7b1-4182-9dee-00707b91284d"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:07.389137 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-57a90118-3171-414d-b243-1ec8550bff2e req-5f04d41a-a2bd-4a1a-856c-3ef92dd5710d service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:07.389465 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-57a90118-3171-414d-b243-1ec8550bff2e req-5f04d41a-a2bd-4a1a-856c-3ef92dd5710d service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:07.400851 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-57a90118-3171-414d-b243-1ec8550bff2e req-5f04d41a-a2bd-4a1a-856c-3ef92dd5710d service nova] Creating event network-changed:21fbb702-a7b1-4182-9dee-00707b91284d for instance 3086f12b-7edc-4ff3-a17d-def512b5679a on hv-cinder-84795 Jun 28 12:16:07.406373 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-57a90118-3171-414d-b243-1ec8550bff2e req-5f04d41a-a2bd-4a1a-856c-3ef92dd5710d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029714 Jun 28 12:16:07.406950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 477/974] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:07.410234 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a3711881-3b05-4913-a80f-ebe04ed1b798 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:07.417870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a3711881-3b05-4913-a80f-ebe04ed1b798 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1313 microversion: 2.1 time: 0.179835 Jun 28 12:16:07.418427 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 498/975] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:07 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:07.960098 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d2d799ec-8689-40d2-94d5-8e17d2385511 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:07.961155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d2d799ec-8689-40d2-94d5-8e17d2385511 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:07.970320 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2d799ec-8689-40d2-94d5-8e17d2385511 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:07.970766 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2d799ec-8689-40d2-94d5-8e17d2385511 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:07.971538 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2d799ec-8689-40d2-94d5-8e17d2385511 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:07.972096 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2d799ec-8689-40d2-94d5-8e17d2385511 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:08.117544 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2d799ec-8689-40d2-94d5-8e17d2385511 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:08.125712 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d2d799ec-8689-40d2-94d5-8e17d2385511 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.174190 Jun 28 12:16:08.126249 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 478/976] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:07 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:08.437448 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-318703c5-d78a-4521-bbbc-da4775cd2597 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:08.438161 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-318703c5-d78a-4521-bbbc-da4775cd2597 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:08.446609 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-318703c5-d78a-4521-bbbc-da4775cd2597 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:08.447165 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-318703c5-d78a-4521-bbbc-da4775cd2597 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:08.448112 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-318703c5-d78a-4521-bbbc-da4775cd2597 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:08.448653 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-318703c5-d78a-4521-bbbc-da4775cd2597 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:08.591202 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-318703c5-d78a-4521-bbbc-da4775cd2597 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:08.599362 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-318703c5-d78a-4521-bbbc-da4775cd2597 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1313 microversion: 2.1 time: 0.166912 Jun 28 12:16:08.599932 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 499/977] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:08 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:09.142666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ef09cab5-f190-4272-81ae-ce222ef071a6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:09.143278 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ef09cab5-f190-4272-81ae-ce222ef071a6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:09.150334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef09cab5-f190-4272-81ae-ce222ef071a6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:09.150789 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef09cab5-f190-4272-81ae-ce222ef071a6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:09.151570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef09cab5-f190-4272-81ae-ce222ef071a6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:09.152013 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ef09cab5-f190-4272-81ae-ce222ef071a6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:09.285968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ef09cab5-f190-4272-81ae-ce222ef071a6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:09.293622 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ef09cab5-f190-4272-81ae-ce222ef071a6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.155082 Jun 28 12:16:09.294185 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 479/978] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:09 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:09.616584 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cecab1cc-2cc0-415d-b0ec-afe6d0c076b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:09.617189 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cecab1cc-2cc0-415d-b0ec-afe6d0c076b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:09.624037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cecab1cc-2cc0-415d-b0ec-afe6d0c076b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:09.624496 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cecab1cc-2cc0-415d-b0ec-afe6d0c076b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:09.625314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cecab1cc-2cc0-415d-b0ec-afe6d0c076b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:09.625736 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cecab1cc-2cc0-415d-b0ec-afe6d0c076b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:09.898032 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cecab1cc-2cc0-415d-b0ec-afe6d0c076b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:09.906403 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cecab1cc-2cc0-415d-b0ec-afe6d0c076b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1313 microversion: 2.1 time: 0.293727 Jun 28 12:16:09.906985 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 500/979] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:09 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:10.314541 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-47460d1e-6e75-4055-a85e-8e6838eb35fa tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:10.315223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-47460d1e-6e75-4055-a85e-8e6838eb35fa tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:10.323206 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-47460d1e-6e75-4055-a85e-8e6838eb35fa tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:10.323743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-47460d1e-6e75-4055-a85e-8e6838eb35fa tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:10.324646 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-47460d1e-6e75-4055-a85e-8e6838eb35fa tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:10.325212 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-47460d1e-6e75-4055-a85e-8e6838eb35fa tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:10.467537 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-47460d1e-6e75-4055-a85e-8e6838eb35fa tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:10.478931 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-47460d1e-6e75-4055-a85e-8e6838eb35fa tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.169715 Jun 28 12:16:10.479712 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 480/980] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:10 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:10.928035 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9b739183-110d-4415-b5da-3ff5a7d4ea7a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:10.929081 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9b739183-110d-4415-b5da-3ff5a7d4ea7a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:10.938873 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b739183-110d-4415-b5da-3ff5a7d4ea7a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:10.939325 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b739183-110d-4415-b5da-3ff5a7d4ea7a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:10.940087 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b739183-110d-4415-b5da-3ff5a7d4ea7a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:10.940518 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9b739183-110d-4415-b5da-3ff5a7d4ea7a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:11.078766 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9b739183-110d-4415-b5da-3ff5a7d4ea7a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:11.086798 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9b739183-110d-4415-b5da-3ff5a7d4ea7a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1313 microversion: 2.1 time: 0.165395 Jun 28 12:16:11.087366 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 501/981] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:10 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:11.501999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-52d6b8de-3300-4bdd-b624-9bd5140b78c7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:11.502853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-52d6b8de-3300-4bdd-b624-9bd5140b78c7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:11.514235 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52d6b8de-3300-4bdd-b624-9bd5140b78c7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:11.514956 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52d6b8de-3300-4bdd-b624-9bd5140b78c7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:11.515731 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52d6b8de-3300-4bdd-b624-9bd5140b78c7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:11.516179 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52d6b8de-3300-4bdd-b624-9bd5140b78c7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:11.653254 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-52d6b8de-3300-4bdd-b624-9bd5140b78c7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:11.662726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-52d6b8de-3300-4bdd-b624-9bd5140b78c7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.167504 Jun 28 12:16:11.663306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 481/982] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:11 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:12.108171 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9c61125b-d007-4e29-afce-c27297e2060b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:12.108943 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9c61125b-d007-4e29-afce-c27297e2060b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:12.115852 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c61125b-d007-4e29-afce-c27297e2060b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:12.116303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c61125b-d007-4e29-afce-c27297e2060b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:12.117117 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c61125b-d007-4e29-afce-c27297e2060b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:12.117552 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9c61125b-d007-4e29-afce-c27297e2060b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:12.252430 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9c61125b-d007-4e29-afce-c27297e2060b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:12.263954 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9c61125b-d007-4e29-afce-c27297e2060b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1313 microversion: 2.1 time: 0.162172 Jun 28 12:16:12.264793 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 502/983] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:12 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:12.684263 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bd341d4a-c26b-427a-863a-bd2a636b38d5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:12.685326 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bd341d4a-c26b-427a-863a-bd2a636b38d5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:12.688169 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:12.694709 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd341d4a-c26b-427a-863a-bd2a636b38d5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:12.695164 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd341d4a-c26b-427a-863a-bd2a636b38d5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:12.696021 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd341d4a-c26b-427a-863a-bd2a636b38d5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:12.696467 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd341d4a-c26b-427a-863a-bd2a636b38d5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:12.851406 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bd341d4a-c26b-427a-863a-bd2a636b38d5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:12.859453 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bd341d4a-c26b-427a-863a-bd2a636b38d5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.181803 Jun 28 12:16:12.860017 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 482/984] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:12 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:13.139162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=4 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:13.264889 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-bbe84c83-e41a-42c5-912b-3ef2fc3b6ff9 req-0e0b0cfc-b027-4d49-b50c-f4eda555bd81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ebbbca-086e-4030-8fdc-29bf57e9b387", "name": "network-vif-plugged", "status": "completed", "tag": "75dec28a-9347-471b-8424-5d6c8781fa5a"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:13.273267 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-bbe84c83-e41a-42c5-912b-3ef2fc3b6ff9 req-0e0b0cfc-b027-4d49-b50c-f4eda555bd81 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:13.273706 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-bbe84c83-e41a-42c5-912b-3ef2fc3b6ff9 req-0e0b0cfc-b027-4d49-b50c-f4eda555bd81 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:13.281802 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a3b67af-0854-4a36-9653-181c2b5552fc tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:13.282794 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4a3b67af-0854-4a36-9653-181c2b5552fc tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:13.287780 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-bbe84c83-e41a-42c5-912b-3ef2fc3b6ff9 req-0e0b0cfc-b027-4d49-b50c-f4eda555bd81 service nova] Creating event network-vif-plugged:75dec28a-9347-471b-8424-5d6c8781fa5a for instance 20ebbbca-086e-4030-8fdc-29bf57e9b387 on hv-cinder-84795 Jun 28 12:16:13.289126 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a3b67af-0854-4a36-9653-181c2b5552fc tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:13.289584 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a3b67af-0854-4a36-9653-181c2b5552fc tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:13.290351 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a3b67af-0854-4a36-9653-181c2b5552fc tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:13.290779 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a3b67af-0854-4a36-9653-181c2b5552fc tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:13.292743 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-bbe84c83-e41a-42c5-912b-3ef2fc3b6ff9 req-0e0b0cfc-b027-4d49-b50c-f4eda555bd81 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158201 Jun 28 12:16:13.293392 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 503/985] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:13.425482 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4a3b67af-0854-4a36-9653-181c2b5552fc tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:13.434340 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4a3b67af-0854-4a36-9653-181c2b5552fc tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1313 microversion: 2.1 time: 0.156763 Jun 28 12:16:13.434916 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 483/986] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:13 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:16:13.876550 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=14 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:13.883650 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-32386e85-f816-44b9-bd94-49456f3172cd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:13.884792 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-32386e85-f816-44b9-bd94-49456f3172cd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:13.896065 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32386e85-f816-44b9-bd94-49456f3172cd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:13.896816 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32386e85-f816-44b9-bd94-49456f3172cd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:13.898139 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32386e85-f816-44b9-bd94-49456f3172cd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:13.898840 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-32386e85-f816-44b9-bd94-49456f3172cd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:14.034696 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-32386e85-f816-44b9-bd94-49456f3172cd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:14.042836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-32386e85-f816-44b9-bd94-49456f3172cd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.168014 Jun 28 12:16:14.043405 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 504/987] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:13 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:14.456117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e55ff4c5-e311-4900-bead-99c93f36ebea tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:14.456805 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e55ff4c5-e311-4900-bead-99c93f36ebea tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:14.465318 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e55ff4c5-e311-4900-bead-99c93f36ebea tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:14.465869 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e55ff4c5-e311-4900-bead-99c93f36ebea tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:14.466844 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e55ff4c5-e311-4900-bead-99c93f36ebea tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:14.467433 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e55ff4c5-e311-4900-bead-99c93f36ebea tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:14.605447 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e55ff4c5-e311-4900-bead-99c93f36ebea tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:14.613790 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e55ff4c5-e311-4900-bead-99c93f36ebea tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1313 microversion: 2.1 time: 0.164006 Jun 28 12:16:14.614325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 484/988] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:14 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:15.064662 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0dc6b55d-4401-431d-978c-eaa5cac30a3c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:15.065605 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0dc6b55d-4401-431d-978c-eaa5cac30a3c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:15.076597 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0dc6b55d-4401-431d-978c-eaa5cac30a3c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:15.077462 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0dc6b55d-4401-431d-978c-eaa5cac30a3c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:15.078256 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0dc6b55d-4401-431d-978c-eaa5cac30a3c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:15.078679 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0dc6b55d-4401-431d-978c-eaa5cac30a3c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:15.231644 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0dc6b55d-4401-431d-978c-eaa5cac30a3c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:15.240189 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0dc6b55d-4401-431d-978c-eaa5cac30a3c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.183032 Jun 28 12:16:15.240755 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 505/989] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:15 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:15.634787 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-76a41a89-3516-4a72-8589-614d8d0937bd tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:15.635453 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-76a41a89-3516-4a72-8589-614d8d0937bd tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:15.643096 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76a41a89-3516-4a72-8589-614d8d0937bd tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:15.643639 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76a41a89-3516-4a72-8589-614d8d0937bd tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:15.644587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76a41a89-3516-4a72-8589-614d8d0937bd tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:15.645188 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76a41a89-3516-4a72-8589-614d8d0937bd tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:15.784647 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-76a41a89-3516-4a72-8589-614d8d0937bd tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:15.792664 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-76a41a89-3516-4a72-8589-614d8d0937bd tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1496 microversion: 2.1 time: 0.161798 Jun 28 12:16:15.793278 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 485/990] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:15 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:16.258574 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-40eb1fbe-aabb-4fb4-832e-24a374339795 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:16.259154 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-40eb1fbe-aabb-4fb4-832e-24a374339795 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:16.265764 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-40eb1fbe-aabb-4fb4-832e-24a374339795 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:16.266848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-40eb1fbe-aabb-4fb4-832e-24a374339795 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:16.267615 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-40eb1fbe-aabb-4fb4-832e-24a374339795 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:16.268066 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-40eb1fbe-aabb-4fb4-832e-24a374339795 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:16.360526 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fed1cb5a-11f7-49ea-8851-b68dee4eaf53 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:16.361052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fed1cb5a-11f7-49ea-8851-b68dee4eaf53 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:16.367204 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fed1cb5a-11f7-49ea-8851-b68dee4eaf53 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:16.367656 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fed1cb5a-11f7-49ea-8851-b68dee4eaf53 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:16.368429 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fed1cb5a-11f7-49ea-8851-b68dee4eaf53 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:16.368867 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fed1cb5a-11f7-49ea-8851-b68dee4eaf53 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:16.394027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fed1cb5a-11f7-49ea-8851-b68dee4eaf53 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:16:16.407523 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-40eb1fbe-aabb-4fb4-832e-24a374339795 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:16.415022 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-40eb1fbe-aabb-4fb4-832e-24a374339795 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.161006 Jun 28 12:16:16.415586 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 506/991] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:16 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:16.483839 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fed1cb5a-11f7-49ea-8851-b68dee4eaf53 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "DELETE /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 204 len: 0 microversion: 2.1 time: 0.126925 Jun 28 12:16:16.484461 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 486/992] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:16:16 2022] DELETE /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 12:16:16.492819 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e514794d-63cb-4515-b710-3eea9031d08a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:16.493467 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e514794d-63cb-4515-b710-3eea9031d08a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:16.499529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e514794d-63cb-4515-b710-3eea9031d08a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:16.499974 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e514794d-63cb-4515-b710-3eea9031d08a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:16.500824 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e514794d-63cb-4515-b710-3eea9031d08a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:16.501262 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e514794d-63cb-4515-b710-3eea9031d08a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:16.637856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e514794d-63cb-4515-b710-3eea9031d08a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:16.646423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e514794d-63cb-4515-b710-3eea9031d08a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1502 microversion: 2.1 time: 0.157461 Jun 28 12:16:16.646969 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 507/993] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:16 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:17.437164 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-de054d1a-aacb-446d-8de2-2de3cded4777 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:17.438588 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-de054d1a-aacb-446d-8de2-2de3cded4777 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:17.449718 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de054d1a-aacb-446d-8de2-2de3cded4777 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:17.450472 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de054d1a-aacb-446d-8de2-2de3cded4777 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:17.451738 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de054d1a-aacb-446d-8de2-2de3cded4777 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:17.452466 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de054d1a-aacb-446d-8de2-2de3cded4777 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:17.599195 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-de054d1a-aacb-446d-8de2-2de3cded4777 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:17.608307 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-de054d1a-aacb-446d-8de2-2de3cded4777 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.178297 Jun 28 12:16:17.608886 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 487/994] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:17 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:17.668360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-15573cc4-ea04-49ea-8239-46c965c3efb6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:17.669452 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-15573cc4-ea04-49ea-8239-46c965c3efb6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:17.679697 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15573cc4-ea04-49ea-8239-46c965c3efb6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:17.680458 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15573cc4-ea04-49ea-8239-46c965c3efb6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:17.681768 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15573cc4-ea04-49ea-8239-46c965c3efb6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:17.682493 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-15573cc4-ea04-49ea-8239-46c965c3efb6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:17.828161 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-15573cc4-ea04-49ea-8239-46c965c3efb6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:17.838462 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-15573cc4-ea04-49ea-8239-46c965c3efb6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1502 microversion: 2.1 time: 0.176405 Jun 28 12:16:17.839199 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 508/995] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:17 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:18.625925 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c9f2a1bc-d0b8-448e-8524-e82ffcc665df tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:18.626536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c9f2a1bc-d0b8-448e-8524-e82ffcc665df tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:18.637269 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9f2a1bc-d0b8-448e-8524-e82ffcc665df tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:18.637659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9f2a1bc-d0b8-448e-8524-e82ffcc665df tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:18.638954 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9f2a1bc-d0b8-448e-8524-e82ffcc665df tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:18.639676 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9f2a1bc-d0b8-448e-8524-e82ffcc665df tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:18.662536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:18.790475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c9f2a1bc-d0b8-448e-8524-e82ffcc665df tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:18.799252 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c9f2a1bc-d0b8-448e-8524-e82ffcc665df tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.177522 Jun 28 12:16:18.799811 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 488/996] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:18 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:18.858239 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e129af25-bba2-464e-9d31-49773dd92184 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:18.858811 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e129af25-bba2-464e-9d31-49773dd92184 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:18.866283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e129af25-bba2-464e-9d31-49773dd92184 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:18.866734 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e129af25-bba2-464e-9d31-49773dd92184 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:18.867511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e129af25-bba2-464e-9d31-49773dd92184 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:18.867938 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e129af25-bba2-464e-9d31-49773dd92184 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:19.004139 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e129af25-bba2-464e-9d31-49773dd92184 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:19.012559 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e129af25-bba2-464e-9d31-49773dd92184 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1502 microversion: 2.1 time: 0.158066 Jun 28 12:16:19.022205 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 509/997] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:18 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:19.804692 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-7a9801f5-ccd0-4d61-a16e-1a83a9104875 req-221e07ba-3804-419a-89e6-e03b455079cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ebbbca-086e-4030-8fdc-29bf57e9b387", "name": "network-vif-deleted", "tag": "75dec28a-9347-471b-8424-5d6c8781fa5a"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:19.814278 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-7a9801f5-ccd0-4d61-a16e-1a83a9104875 req-221e07ba-3804-419a-89e6-e03b455079cc service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:19.815016 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-7a9801f5-ccd0-4d61-a16e-1a83a9104875 req-221e07ba-3804-419a-89e6-e03b455079cc service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:19.819767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9a538d00-1c84-4f18-ad3d-ed9f116ae737 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:19.820379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9a538d00-1c84-4f18-ad3d-ed9f116ae737 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:19.827845 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a538d00-1c84-4f18-ad3d-ed9f116ae737 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:19.828303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a538d00-1c84-4f18-ad3d-ed9f116ae737 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:19.829521 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a538d00-1c84-4f18-ad3d-ed9f116ae737 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:19.830700 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a538d00-1c84-4f18-ad3d-ed9f116ae737 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:19.840592 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-7a9801f5-ccd0-4d61-a16e-1a83a9104875 req-221e07ba-3804-419a-89e6-e03b455079cc service nova] Creating event network-vif-deleted:75dec28a-9347-471b-8424-5d6c8781fa5a for instance 20ebbbca-086e-4030-8fdc-29bf57e9b387 on hv-cinder-84795 Jun 28 12:16:19.848456 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-7a9801f5-ccd0-4d61-a16e-1a83a9104875 req-221e07ba-3804-419a-89e6-e03b455079cc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047669 Jun 28 12:16:19.849545 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 489/998] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:19.980435 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9a538d00-1c84-4f18-ad3d-ed9f116ae737 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:19.988707 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9a538d00-1c84-4f18-ad3d-ed9f116ae737 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.176193 Jun 28 12:16:19.989319 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 510/999] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:19 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:20.033717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f26a7014-eba0-4585-887a-7dc79ce04ab8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:20.034455 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f26a7014-eba0-4585-887a-7dc79ce04ab8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:20.041198 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f26a7014-eba0-4585-887a-7dc79ce04ab8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:20.041653 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f26a7014-eba0-4585-887a-7dc79ce04ab8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:20.042401 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f26a7014-eba0-4585-887a-7dc79ce04ab8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:20.042854 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f26a7014-eba0-4585-887a-7dc79ce04ab8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:20.074728 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f26a7014-eba0-4585-887a-7dc79ce04ab8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:20.075180 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f26a7014-eba0-4585-887a-7dc79ce04ab8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:20.075642 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-f26a7014-eba0-4585-887a-7dc79ce04ab8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lazy-loading 'fault' on Instance uuid 20ebbbca-086e-4030-8fdc-29bf57e9b387 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:16:20.119030 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f26a7014-eba0-4585-887a-7dc79ce04ab8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:20.127056 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f26a7014-eba0-4585-887a-7dc79ce04ab8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 200 len: 1303 microversion: 2.1 time: 0.100022 Jun 28 12:16:20.127627 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 490/1000] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:20 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:21.014900 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a778ff33-f066-43a3-b03f-e4132af42f8a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:21.016259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a778ff33-f066-43a3-b03f-e4132af42f8a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:21.024052 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a778ff33-f066-43a3-b03f-e4132af42f8a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:21.024618 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a778ff33-f066-43a3-b03f-e4132af42f8a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:21.025422 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a778ff33-f066-43a3-b03f-e4132af42f8a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:21.025857 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a778ff33-f066-43a3-b03f-e4132af42f8a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:21.144123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a4a882f1-24f3-43ef-a898-e05f1bff2627 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:21.144727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a4a882f1-24f3-43ef-a898-e05f1bff2627 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 20ebbbca-086e-4030-8fdc-29bf57e9b387] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:21.152274 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4a882f1-24f3-43ef-a898-e05f1bff2627 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:21.153207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4a882f1-24f3-43ef-a898-e05f1bff2627 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:21.154025 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4a882f1-24f3-43ef-a898-e05f1bff2627 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:21.154762 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4a882f1-24f3-43ef-a898-e05f1bff2627 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:21.169310 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-a4a882f1-24f3-43ef-a898-e05f1bff2627 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] HTTP exception thrown: Instance 20ebbbca-086e-4030-8fdc-29bf57e9b387 could not be found. Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a4a882f1-24f3-43ef-a898-e05f1bff2627 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Request method failure captured: Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 HTTP/1.1 Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuvD_RKSufT4QeFE6FsWNK9tXREHIB1V9looQzTab6mx5nt7PSHHDJlh34bc7O39FE9OotQqI_9ozxA4fc2wiXJf_3oEMat25MSpDV1TnIY9zA5mxibV7itDE2diFhdGV-YWazoBVhFBG4eZ2avMSCGLG3Nly5WIQH0LeilOesWZq-sM Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 1affbea314ef42ae9c8eb051f633e3df Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesActionsTest-699889999 Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:16:21.171155 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1affbea314ef42ae9c8eb051f633e3df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1affbea314ef42ae9c8eb051f633e3df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1affbea314ef42ae9c8eb051f633e3df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1affbea314ef42ae9c8eb051f633e3df"}]}] Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesActionsTest-699889999 Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 1affbea314ef42ae9c8eb051f633e3df Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesActionsTest-699889999 Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesActionsTest-699889999-project Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: f0c23febe0064a6abddc75cae27e7ef4 Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesActionsTest-699889999-project Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 20ebbbca-086e-4030-8fdc-29bf57e9b387 could not be found. Jun 28 12:16:21.172618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '20ebbbca-086e-4030-8fdc-29bf57e9b387'} Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ebbbca-086e-4030-8fdc-29bf57e9b387 could not be found. Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:16:21.173494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ebbbca-086e-4030-8fdc-29bf57e9b387 could not be found. Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ebbbca-086e-4030-8fdc-29bf57e9b387 could not be found. Jun 28 12:16:21.175110 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:21.178082 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a4a882f1-24f3-43ef-a898-e05f1bff2627 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Returning 404 to user: Instance 20ebbbca-086e-4030-8fdc-29bf57e9b387 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:16:21.178082 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a4a882f1-24f3-43ef-a898-e05f1bff2627 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387" status: 404 len: 111 microversion: 2.1 time: 0.032725 Jun 28 12:16:21.178387 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a778ff33-f066-43a3-b03f-e4132af42f8a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:21.183974 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 491/1001] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:21 2022] GET /compute/v2.1/servers/20ebbbca-086e-4030-8fdc-29bf57e9b387 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:16:21.193328 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a778ff33-f066-43a3-b03f-e4132af42f8a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.184469 Jun 28 12:16:21.194781 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-e7a7aeff-3e5f-4cc8-ad53-d4e845ac6cbc req-21b79d46-b3a3-4311-a031-06bcac4e8bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3086f12b-7edc-4ff3-a17d-def512b5679a", "name": "network-vif-plugged", "status": "completed", "tag": "21fbb702-a7b1-4182-9dee-00707b91284d"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:21.197070 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 511/1002] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:21 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:21.206918 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e7a7aeff-3e5f-4cc8-ad53-d4e845ac6cbc req-21b79d46-b3a3-4311-a031-06bcac4e8bee service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:21.207703 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e7a7aeff-3e5f-4cc8-ad53-d4e845ac6cbc req-21b79d46-b3a3-4311-a031-06bcac4e8bee service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:21.221878 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-e7a7aeff-3e5f-4cc8-ad53-d4e845ac6cbc req-21b79d46-b3a3-4311-a031-06bcac4e8bee service nova] Creating event network-vif-plugged:21fbb702-a7b1-4182-9dee-00707b91284d for instance 3086f12b-7edc-4ff3-a17d-def512b5679a on hv-cinder-84795 Jun 28 12:16:21.223278 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-337540399", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "networks": [{"uuid": "bddbb7e5-f537-435c-9947-5d2bad264218"}]}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:21.226971 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-e7a7aeff-3e5f-4cc8-ad53-d4e845ac6cbc req-21b79d46-b3a3-4311-a031-06bcac4e8bee service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038494 Jun 28 12:16:21.227791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 492/1003] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:21.277017 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] validate_networks() for [('bddbb7e5-f537-435c-9947-5d2bad264218', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:16:21.694150 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:16:21.694575 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:16:21.695050 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:16:21.695457 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:16:21.695874 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:16:21.706774 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:21.707223 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:21.708020 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:21.708482 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:21.715263 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=100 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:21.727046 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Getting quotas for project 1affbea314ef42ae9c8eb051f633e3df. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:16:21.731088 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Getting quotas for user f0c23febe0064a6abddc75cae27e7ef4 and project 1affbea314ef42ae9c8eb051f633e3df. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:16:21.743372 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:16:21.745697 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:16:21.796028 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0516b71e-c297-46d1-9262-1f10456fbed4 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576792 Jun 28 12:16:21.796686 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 512/1004] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 28 12:16:21.807743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-85a8395d-2e44-41aa-9c5d-0385febebcc8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:21.808530 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-85a8395d-2e44-41aa-9c5d-0385febebcc8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:21.863803 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-85a8395d-2e44-41aa-9c5d-0385febebcc8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:21.870651 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-85a8395d-2e44-41aa-9c5d-0385febebcc8 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1213 microversion: 2.1 time: 0.067230 Jun 28 12:16:21.871244 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 493/1005] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:21 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:22.212454 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e7701d6f-e099-40db-9e01-061e08aa55b5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:22.213042 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e7701d6f-e099-40db-9e01-061e08aa55b5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:22.222457 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7701d6f-e099-40db-9e01-061e08aa55b5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:22.222907 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7701d6f-e099-40db-9e01-061e08aa55b5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:22.223751 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7701d6f-e099-40db-9e01-061e08aa55b5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:22.224187 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e7701d6f-e099-40db-9e01-061e08aa55b5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:22.372555 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e7701d6f-e099-40db-9e01-061e08aa55b5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:22.381977 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e7701d6f-e099-40db-9e01-061e08aa55b5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1260 microversion: 2.1 time: 0.176020 Jun 28 12:16:22.382539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 513/1006] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:22 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:22.892279 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f5435c68-a797-4981-b2a1-05e40f3e5058 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:22.893347 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f5435c68-a797-4981-b2a1-05e40f3e5058 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:22.905808 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5435c68-a797-4981-b2a1-05e40f3e5058 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:22.906570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5435c68-a797-4981-b2a1-05e40f3e5058 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:22.907949 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5435c68-a797-4981-b2a1-05e40f3e5058 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:22.908579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f5435c68-a797-4981-b2a1-05e40f3e5058 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:22.970739 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f5435c68-a797-4981-b2a1-05e40f3e5058 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:22.978458 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f5435c68-a797-4981-b2a1-05e40f3e5058 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1265 microversion: 2.1 time: 0.093275 Jun 28 12:16:22.979034 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 494/1007] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:22 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:23.407485 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8c0c4e38-e7a6-487d-9946-926a4ac7d167 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:23.408658 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8c0c4e38-e7a6-487d-9946-926a4ac7d167 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:23.419703 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c0c4e38-e7a6-487d-9946-926a4ac7d167 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:23.420450 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c0c4e38-e7a6-487d-9946-926a4ac7d167 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:23.421770 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c0c4e38-e7a6-487d-9946-926a4ac7d167 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:23.422481 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8c0c4e38-e7a6-487d-9946-926a4ac7d167 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:23.571307 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8c0c4e38-e7a6-487d-9946-926a4ac7d167 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:23.583296 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8c0c4e38-e7a6-487d-9946-926a4ac7d167 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1445 microversion: 2.1 time: 0.183150 Jun 28 12:16:23.583887 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 514/1008] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:23 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1445 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:23.605214 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dce6f0f9-f341-4792-a2d1-685ee5f3c4d7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:23.605829 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dce6f0f9-f341-4792-a2d1-685ee5f3c4d7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:23.612497 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce6f0f9-f341-4792-a2d1-685ee5f3c4d7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:23.612934 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce6f0f9-f341-4792-a2d1-685ee5f3c4d7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:23.613745 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce6f0f9-f341-4792-a2d1-685ee5f3c4d7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:23.614183 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce6f0f9-f341-4792-a2d1-685ee5f3c4d7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:23.765879 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dce6f0f9-f341-4792-a2d1-685ee5f3c4d7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:23.773796 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dce6f0f9-f341-4792-a2d1-685ee5f3c4d7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1445 microversion: 2.1 time: 0.172668 Jun 28 12:16:23.774383 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 495/1009] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:23 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1445 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:16:23.996289 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c508e661-6d4f-4b27-b0a6-5f01bda91a1e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:23.996518 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c508e661-6d4f-4b27-b0a6-5f01bda91a1e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:24.002666 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c508e661-6d4f-4b27-b0a6-5f01bda91a1e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:24.003097 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c508e661-6d4f-4b27-b0a6-5f01bda91a1e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:24.003895 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c508e661-6d4f-4b27-b0a6-5f01bda91a1e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:24.004361 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c508e661-6d4f-4b27-b0a6-5f01bda91a1e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:24.076455 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-c508e661-6d4f-4b27-b0a6-5f01bda91a1e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:24.084575 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c508e661-6d4f-4b27-b0a6-5f01bda91a1e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1271 microversion: 2.1 time: 0.092586 Jun 28 12:16:24.085483 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 515/1010] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:23 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:25.102459 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-198025a2-3281-4497-ab51-b982070c2f34 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:25.103095 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-198025a2-3281-4497-ab51-b982070c2f34 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:25.109714 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-198025a2-3281-4497-ab51-b982070c2f34 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:25.110277 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-198025a2-3281-4497-ab51-b982070c2f34 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:25.111289 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-198025a2-3281-4497-ab51-b982070c2f34 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:25.111732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-198025a2-3281-4497-ab51-b982070c2f34 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:25.340087 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-198025a2-3281-4497-ab51-b982070c2f34 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:25.347984 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-198025a2-3281-4497-ab51-b982070c2f34 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1313 microversion: 2.1 time: 0.249408 Jun 28 12:16:25.358649 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 496/1011] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:25 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:25.494970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-15fbc358-8f6d-478f-a838-86d4ca768cf2 req-5deed9e1-ba2c-4476-aa13-4f235f2a5b16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "495f4b79-333a-46a6-ad4e-68aa079219be", "tag": "3410c26e-effe-4847-a53b-5795ba6079bb"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:25.506194 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-15fbc358-8f6d-478f-a838-86d4ca768cf2 req-5deed9e1-ba2c-4476-aa13-4f235f2a5b16 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:25.507040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-15fbc358-8f6d-478f-a838-86d4ca768cf2 req-5deed9e1-ba2c-4476-aa13-4f235f2a5b16 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:25.521880 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-15fbc358-8f6d-478f-a838-86d4ca768cf2 req-5deed9e1-ba2c-4476-aa13-4f235f2a5b16 service nova] Creating event network-changed:3410c26e-effe-4847-a53b-5795ba6079bb for instance 495f4b79-333a-46a6-ad4e-68aa079219be on hv-cinder-84795 Jun 28 12:16:25.527429 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-15fbc358-8f6d-478f-a838-86d4ca768cf2 req-5deed9e1-ba2c-4476-aa13-4f235f2a5b16 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036996 Jun 28 12:16:25.528040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 516/1012] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:25.957166 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-bbdd0b7e-5ef3-42e3-8d32-21761b138eb5 req-08da2923-b1af-4c2b-8643-51db78bafa17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3086f12b-7edc-4ff3-a17d-def512b5679a", "tag": "21fbb702-a7b1-4182-9dee-00707b91284d"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:25.966449 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-bbdd0b7e-5ef3-42e3-8d32-21761b138eb5 req-08da2923-b1af-4c2b-8643-51db78bafa17 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:25.967056 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-bbdd0b7e-5ef3-42e3-8d32-21761b138eb5 req-08da2923-b1af-4c2b-8643-51db78bafa17 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:25.982671 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-bbdd0b7e-5ef3-42e3-8d32-21761b138eb5 req-08da2923-b1af-4c2b-8643-51db78bafa17 service nova] Creating event network-changed:21fbb702-a7b1-4182-9dee-00707b91284d for instance 3086f12b-7edc-4ff3-a17d-def512b5679a on hv-cinder-84795 Jun 28 12:16:25.988217 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-bbdd0b7e-5ef3-42e3-8d32-21761b138eb5 req-08da2923-b1af-4c2b-8643-51db78bafa17 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103730 Jun 28 12:16:25.989223 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 497/1013] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:26.366943 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9761eca2-2a78-4884-bb7b-ff71487800f0 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:26.367746 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9761eca2-2a78-4884-bb7b-ff71487800f0 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:26.374749 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9761eca2-2a78-4884-bb7b-ff71487800f0 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:26.375177 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9761eca2-2a78-4884-bb7b-ff71487800f0 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:26.375945 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9761eca2-2a78-4884-bb7b-ff71487800f0 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:26.376368 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9761eca2-2a78-4884-bb7b-ff71487800f0 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:26.508892 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9761eca2-2a78-4884-bb7b-ff71487800f0 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:26.516652 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9761eca2-2a78-4884-bb7b-ff71487800f0 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1313 microversion: 2.1 time: 0.154689 Jun 28 12:16:26.517259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 517/1014] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:26 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:26.713681 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-843f5005-ebb7-49ee-88af-6fc6da26d65e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:26.714271 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-843f5005-ebb7-49ee-88af-6fc6da26d65e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:26.721455 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-843f5005-ebb7-49ee-88af-6fc6da26d65e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:26.721915 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-843f5005-ebb7-49ee-88af-6fc6da26d65e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:26.722696 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-843f5005-ebb7-49ee-88af-6fc6da26d65e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:26.723372 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-843f5005-ebb7-49ee-88af-6fc6da26d65e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:26.748119 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-843f5005-ebb7-49ee-88af-6fc6da26d65e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/ips" status: 200 len: 150 microversion: 2.1 time: 0.038768 Jun 28 12:16:26.748705 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 498/1015] 10.222.0.55 () {58 vars in 1247 bytes} [Tue Jun 28 12:16:26 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:27.537140 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-72438d98-07cb-40e3-b52d-e08e4f5047cb tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:27.537895 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-72438d98-07cb-40e3-b52d-e08e4f5047cb tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:27.541539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:27.545690 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72438d98-07cb-40e3-b52d-e08e4f5047cb tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:27.546167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72438d98-07cb-40e3-b52d-e08e4f5047cb tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:27.547057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72438d98-07cb-40e3-b52d-e08e4f5047cb tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:27.547537 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-72438d98-07cb-40e3-b52d-e08e4f5047cb tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:27.693749 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-72438d98-07cb-40e3-b52d-e08e4f5047cb tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:27.701582 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-72438d98-07cb-40e3-b52d-e08e4f5047cb tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1313 microversion: 2.1 time: 0.170271 Jun 28 12:16:27.702141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 518/1016] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:27 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:28.146216 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-41b98c0b-94f3-4d8e-9bcb-d95679cd81b5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13396a0b-4793-4cbe-b4ed-9f6b8c96c403"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:28.147259 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-41b98c0b-94f3-4d8e-9bcb-d95679cd81b5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:28.154320 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41b98c0b-94f3-4d8e-9bcb-d95679cd81b5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:28.154767 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41b98c0b-94f3-4d8e-9bcb-d95679cd81b5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:28.155524 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41b98c0b-94f3-4d8e-9bcb-d95679cd81b5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:28.155956 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41b98c0b-94f3-4d8e-9bcb-d95679cd81b5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:28.493077 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-41b98c0b-94f3-4d8e-9bcb-d95679cd81b5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351068 Jun 28 12:16:28.494071 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 499/1017] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:16:28 2022] POST /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:28.719622 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-fa0266bc-6764-4c25-9361-8050515f61a7 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:28.720170 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-fa0266bc-6764-4c25-9361-8050515f61a7 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:28.727403 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa0266bc-6764-4c25-9361-8050515f61a7 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:28.727851 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa0266bc-6764-4c25-9361-8050515f61a7 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:28.729063 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa0266bc-6764-4c25-9361-8050515f61a7 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:28.729550 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-fa0266bc-6764-4c25-9361-8050515f61a7 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:29.040165 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-fa0266bc-6764-4c25-9361-8050515f61a7 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:29.049152 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-fa0266bc-6764-4c25-9361-8050515f61a7 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1313 microversion: 2.1 time: 0.333387 Jun 28 12:16:29.060116 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 519/1018] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:28 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:30.072441 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c312d664-a45c-4d94-999c-02723a7abb7e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:30.073610 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c312d664-a45c-4d94-999c-02723a7abb7e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:30.084669 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c312d664-a45c-4d94-999c-02723a7abb7e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:30.085165 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c312d664-a45c-4d94-999c-02723a7abb7e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:30.085936 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c312d664-a45c-4d94-999c-02723a7abb7e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:30.086373 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c312d664-a45c-4d94-999c-02723a7abb7e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:30.221089 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c312d664-a45c-4d94-999c-02723a7abb7e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:30.229515 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c312d664-a45c-4d94-999c-02723a7abb7e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1313 microversion: 2.1 time: 0.165107 Jun 28 12:16:30.230097 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 500/1019] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:30 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:31.219448 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-e8c647fa-8dfe-4686-8d2a-0b31d1d3dda8 req-782ebe49-3cf2-4ad7-8849-585ffe4fb9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "495f4b79-333a-46a6-ad4e-68aa079219be", "name": "network-vif-plugged", "status": "completed", "tag": "3410c26e-effe-4847-a53b-5795ba6079bb"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:31.229234 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-e8c647fa-8dfe-4686-8d2a-0b31d1d3dda8 req-782ebe49-3cf2-4ad7-8849-585ffe4fb9e8 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:31.229674 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-e8c647fa-8dfe-4686-8d2a-0b31d1d3dda8 req-782ebe49-3cf2-4ad7-8849-585ffe4fb9e8 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:31.243047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-e8c647fa-8dfe-4686-8d2a-0b31d1d3dda8 req-782ebe49-3cf2-4ad7-8849-585ffe4fb9e8 service nova] Creating event network-vif-plugged:3410c26e-effe-4847-a53b-5795ba6079bb for instance 495f4b79-333a-46a6-ad4e-68aa079219be on hv-cinder-84795 Jun 28 12:16:31.246382 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f6106433-1d8f-460c-a9c1-a7bb885062e6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:31.247165 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f6106433-1d8f-460c-a9c1-a7bb885062e6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:31.248152 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-e8c647fa-8dfe-4686-8d2a-0b31d1d3dda8 req-782ebe49-3cf2-4ad7-8849-585ffe4fb9e8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032530 Jun 28 12:16:31.248739 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 520/1020] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:31.254356 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6106433-1d8f-460c-a9c1-a7bb885062e6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:31.254813 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6106433-1d8f-460c-a9c1-a7bb885062e6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:31.255635 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6106433-1d8f-460c-a9c1-a7bb885062e6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:31.256080 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6106433-1d8f-460c-a9c1-a7bb885062e6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:31.395487 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6106433-1d8f-460c-a9c1-a7bb885062e6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:31.404333 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f6106433-1d8f-460c-a9c1-a7bb885062e6 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1313 microversion: 2.1 time: 0.162139 Jun 28 12:16:31.404951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 501/1021] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:31 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:16:32.426672 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d2871f6b-a65c-42a5-9c55-9ed02783326e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:32.428528 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d2871f6b-a65c-42a5-9c55-9ed02783326e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:32.431663 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:32.432720 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:32.443212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2871f6b-a65c-42a5-9c55-9ed02783326e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:32.444162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2871f6b-a65c-42a5-9c55-9ed02783326e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:32.444931 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2871f6b-a65c-42a5-9c55-9ed02783326e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:32.445354 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d2871f6b-a65c-42a5-9c55-9ed02783326e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:32.592845 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d2871f6b-a65c-42a5-9c55-9ed02783326e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:32.600837 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d2871f6b-a65c-42a5-9c55-9ed02783326e tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1313 microversion: 2.1 time: 0.181451 Jun 28 12:16:32.601449 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 521/1022] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:32 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:33.622112 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7648c8b6-35f6-40dc-ae0b-1eacec4e942c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:33.622762 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7648c8b6-35f6-40dc-ae0b-1eacec4e942c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:33.626503 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:33.627420 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:33.635996 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7648c8b6-35f6-40dc-ae0b-1eacec4e942c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:33.636629 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7648c8b6-35f6-40dc-ae0b-1eacec4e942c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:33.637743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7648c8b6-35f6-40dc-ae0b-1eacec4e942c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:33.638336 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7648c8b6-35f6-40dc-ae0b-1eacec4e942c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:33.777524 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7648c8b6-35f6-40dc-ae0b-1eacec4e942c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:33.786414 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7648c8b6-35f6-40dc-ae0b-1eacec4e942c tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1497 microversion: 2.1 time: 0.170623 Jun 28 12:16:33.788337 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 502/1023] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:33 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:34.387666 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9249be22-c93f-477a-b4af-e86bc1cbc277 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:34.388214 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9249be22-c93f-477a-b4af-e86bc1cbc277 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:34.396440 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9249be22-c93f-477a-b4af-e86bc1cbc277 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:34.397042 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9249be22-c93f-477a-b4af-e86bc1cbc277 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:34.397798 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9249be22-c93f-477a-b4af-e86bc1cbc277 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:34.398233 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9249be22-c93f-477a-b4af-e86bc1cbc277 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:34.423843 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9249be22-c93f-477a-b4af-e86bc1cbc277 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:16:34.505307 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9249be22-c93f-477a-b4af-e86bc1cbc277 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "DELETE /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 204 len: 0 microversion: 2.1 time: 0.123769 Jun 28 12:16:34.505880 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 522/1024] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:16:34 2022] DELETE /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:16:34.514157 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d4d72eac-a78e-4183-a1c3-e257d3b5487b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:34.514783 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d4d72eac-a78e-4183-a1c3-e257d3b5487b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:34.520750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4d72eac-a78e-4183-a1c3-e257d3b5487b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:34.521236 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4d72eac-a78e-4183-a1c3-e257d3b5487b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:34.522085 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4d72eac-a78e-4183-a1c3-e257d3b5487b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:34.522522 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4d72eac-a78e-4183-a1c3-e257d3b5487b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:34.660659 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d4d72eac-a78e-4183-a1c3-e257d3b5487b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:34.668610 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d4d72eac-a78e-4183-a1c3-e257d3b5487b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1503 microversion: 2.1 time: 0.158318 Jun 28 12:16:34.669189 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 503/1025] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:34 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:35.691168 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-1442f454-0211-4b33-961c-3575771fa679 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:35.692320 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-1442f454-0211-4b33-961c-3575771fa679 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:35.700379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1442f454-0211-4b33-961c-3575771fa679 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:35.700822 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1442f454-0211-4b33-961c-3575771fa679 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:35.701597 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1442f454-0211-4b33-961c-3575771fa679 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:35.702056 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-1442f454-0211-4b33-961c-3575771fa679 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:35.850980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-1442f454-0211-4b33-961c-3575771fa679 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:35.859011 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-1442f454-0211-4b33-961c-3575771fa679 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1503 microversion: 2.1 time: 0.175065 Jun 28 12:16:35.859599 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 523/1026] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:35 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:36.881707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-af979e1d-0ad4-47ac-8012-470e70494a3a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:36.882428 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-af979e1d-0ad4-47ac-8012-470e70494a3a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:36.890252 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af979e1d-0ad4-47ac-8012-470e70494a3a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:36.890711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af979e1d-0ad4-47ac-8012-470e70494a3a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:36.891448 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af979e1d-0ad4-47ac-8012-470e70494a3a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:36.892102 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af979e1d-0ad4-47ac-8012-470e70494a3a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:37.031852 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-af979e1d-0ad4-47ac-8012-470e70494a3a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:37.040173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-af979e1d-0ad4-47ac-8012-470e70494a3a tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1503 microversion: 2.1 time: 0.162386 Jun 28 12:16:37.040754 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 504/1027] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:36 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:37.759687 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-10eb9fd1-9be2-4afd-ad29-093163bb846c req-dafded3e-9fec-4be8-8ed7-35f6134249c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "495f4b79-333a-46a6-ad4e-68aa079219be", "name": "network-vif-deleted", "tag": "3410c26e-effe-4847-a53b-5795ba6079bb"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:37.768877 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-10eb9fd1-9be2-4afd-ad29-093163bb846c req-dafded3e-9fec-4be8-8ed7-35f6134249c2 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:37.769342 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-10eb9fd1-9be2-4afd-ad29-093163bb846c req-dafded3e-9fec-4be8-8ed7-35f6134249c2 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:37.781248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-10eb9fd1-9be2-4afd-ad29-093163bb846c req-dafded3e-9fec-4be8-8ed7-35f6134249c2 service nova] Creating event network-vif-deleted:3410c26e-effe-4847-a53b-5795ba6079bb for instance 495f4b79-333a-46a6-ad4e-68aa079219be on hv-cinder-84795 Jun 28 12:16:37.786430 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-10eb9fd1-9be2-4afd-ad29-093163bb846c req-dafded3e-9fec-4be8-8ed7-35f6134249c2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031266 Jun 28 12:16:37.787060 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 524/1028] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:38.059296 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-09aa9ab5-ce3f-4289-adcd-0169e06291b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:38.059928 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-09aa9ab5-ce3f-4289-adcd-0169e06291b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:38.066732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09aa9ab5-ce3f-4289-adcd-0169e06291b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:38.067165 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09aa9ab5-ce3f-4289-adcd-0169e06291b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:38.067963 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09aa9ab5-ce3f-4289-adcd-0169e06291b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:38.068781 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09aa9ab5-ce3f-4289-adcd-0169e06291b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:38.103628 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09aa9ab5-ce3f-4289-adcd-0169e06291b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:38.104082 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09aa9ab5-ce3f-4289-adcd-0169e06291b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:38.104591 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-09aa9ab5-ce3f-4289-adcd-0169e06291b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lazy-loading 'fault' on Instance uuid 495f4b79-333a-46a6-ad4e-68aa079219be {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:16:38.147417 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-09aa9ab5-ce3f-4289-adcd-0169e06291b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0c23febe0064a6abddc75cae27e7ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1affbea314ef42ae9c8eb051f633e3df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:38.155229 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-09aa9ab5-ce3f-4289-adcd-0169e06291b5 tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 200 len: 1303 microversion: 2.1 time: 0.100101 Jun 28 12:16:38.156629 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 505/1029] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:38 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:38.163790 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d19706b5-67f4-4ca5-a614-f52dfbe890c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: .version_select at 0x7f3932d770d0>, body: {"keypair": {"name": "tempest-keypair-1322755310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnLU8bIz7JGofdC94xNdL/jeKXSmGRvUR9uSI3HaXMUGSqIi35SuQ72P8sqn2La0e1SrOohFhYnetFIOc9uokFp4Ak0FcY1GcAcP9crg/wx5xnDTGwyh9WwdK4HVXencw=="}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:38.178965 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-d19706b5-67f4-4ca5-a614-f52dfbe890c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:16:38.188428 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-d19706b5-67f4-4ca5-a614-f52dfbe890c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for user f2f9826f53b44e1bbaf721d66de1356b and project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'key_pairs'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:16:38.219191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d19706b5-67f4-4ca5-a614-f52dfbe890c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059591 Jun 28 12:16:38.219954 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 525/1030] 10.222.0.55 () {60 vars in 1158 bytes} [Tue Jun 28 12:16:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:39.171727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cbfbcf56-1d06-4d9d-9423-a238bdeaed1b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:39.173040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cbfbcf56-1d06-4d9d-9423-a238bdeaed1b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] [instance: 495f4b79-333a-46a6-ad4e-68aa079219be] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:39.179816 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbfbcf56-1d06-4d9d-9423-a238bdeaed1b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:39.180527 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbfbcf56-1d06-4d9d-9423-a238bdeaed1b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:39.181335 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbfbcf56-1d06-4d9d-9423-a238bdeaed1b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:39.181940 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cbfbcf56-1d06-4d9d-9423-a238bdeaed1b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:39.196692 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-cbfbcf56-1d06-4d9d-9423-a238bdeaed1b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] HTTP exception thrown: Instance 495f4b79-333a-46a6-ad4e-68aa079219be could not be found. Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cbfbcf56-1d06-4d9d-9423-a238bdeaed1b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Request method failure captured: Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be HTTP/1.1 Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuvD_RKSufT4QeFE6FsWNK9tXREHIB1V9looQzTab6mx5nt7PSHHDJlh34bc7O39FE9OotQqI_9ozxA4fc2wiXJf_3oEMat25MSpDV1TnIY9zA5mxibV7itDE2diFhdGV-YWazoBVhFBG4eZ2avMSCGLG3Nly5WIQH0LeilOesWZq-sM Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 1affbea314ef42ae9c8eb051f633e3df Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesActionsTest-699889999 Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:16:39.198430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1affbea314ef42ae9c8eb051f633e3df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1affbea314ef42ae9c8eb051f633e3df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1affbea314ef42ae9c8eb051f633e3df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1affbea314ef42ae9c8eb051f633e3df"}]}] Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesActionsTest-699889999 Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 1affbea314ef42ae9c8eb051f633e3df Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesActionsTest-699889999 Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesActionsTest-699889999-project Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: f0c23febe0064a6abddc75cae27e7ef4 Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesActionsTest-699889999-project Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 495f4b79-333a-46a6-ad4e-68aa079219be could not be found. Jun 28 12:16:39.200237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '495f4b79-333a-46a6-ad4e-68aa079219be'} Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 495f4b79-333a-46a6-ad4e-68aa079219be could not be found. Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:16:39.201666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 495f4b79-333a-46a6-ad4e-68aa079219be could not be found. Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 495f4b79-333a-46a6-ad4e-68aa079219be could not be found. Jun 28 12:16:39.203494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:39.205255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cbfbcf56-1d06-4d9d-9423-a238bdeaed1b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] Returning 404 to user: Instance 495f4b79-333a-46a6-ad4e-68aa079219be could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:16:39.205255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cbfbcf56-1d06-4d9d-9423-a238bdeaed1b tempest-VolumesActionsTest-699889999 tempest-VolumesActionsTest-699889999-project] 10.222.0.55 "GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be" status: 404 len: 111 microversion: 2.1 time: 0.032607 Jun 28 12:16:39.205255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 506/1031] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:39 2022] GET /compute/v2.1/servers/495f4b79-333a-46a6-ad4e-68aa079219be => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:16:39.588440 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-105450985", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ab7246a-96e7-4fc8-aac1-d967c789fbd7"}], "security_groups": [{"name": "tempest-securitygroup--1373152006"}], "key_name": "tempest-keypair-1322755310", "user_data": "}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:39.759212 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] validate_networks() for [('7ab7246a-96e7-4fc8-aac1-d967c789fbd7', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:16:40.169217 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:16:40.169647 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:16:40.170125 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:16:40.170520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:16:40.170923 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:16:40.180315 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:40.180762 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:40.181594 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:40.182022 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:40.198883 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:16:40.202957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for user f2f9826f53b44e1bbaf721d66de1356b and project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:16:40.215037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:16:40.217444 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:16:40.276681 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d6ac0d63-3016-4556-84ce-908762d5295f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.692662 Jun 28 12:16:40.277367 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 526/1032] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:16:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:16:40.287497 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-51aae286-8517-46cd-b3e5-39d4a8c3c074 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:40.288076 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-51aae286-8517-46cd-b3e5-39d4a8c3c074 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:40.343965 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-51aae286-8517-46cd-b3e5-39d4a8c3c074 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:40.350605 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-51aae286-8517-46cd-b3e5-39d4a8c3c074 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1241 microversion: 2.1 time: 0.066974 Jun 28 12:16:40.351152 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 507/1033] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:40 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:41.372682 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-de6e23c1-80e7-4d51-91ef-8694e8f49a1a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:41.373682 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-de6e23c1-80e7-4d51-91ef-8694e8f49a1a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:41.384458 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de6e23c1-80e7-4d51-91ef-8694e8f49a1a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:41.384936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de6e23c1-80e7-4d51-91ef-8694e8f49a1a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:41.385733 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de6e23c1-80e7-4d51-91ef-8694e8f49a1a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:41.386165 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-de6e23c1-80e7-4d51-91ef-8694e8f49a1a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:41.451975 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-de6e23c1-80e7-4d51-91ef-8694e8f49a1a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:41.459920 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-de6e23c1-80e7-4d51-91ef-8694e8f49a1a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1245 microversion: 2.1 time: 0.094686 Jun 28 12:16:41.460485 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 527/1034] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:41 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:42.486579 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0a5df930-34b4-497f-a2b4-9978f1ca8595 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:42.487452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0a5df930-34b4-497f-a2b4-9978f1ca8595 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:42.499850 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a5df930-34b4-497f-a2b4-9978f1ca8595 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:42.500662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a5df930-34b4-497f-a2b4-9978f1ca8595 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:42.502009 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a5df930-34b4-497f-a2b4-9978f1ca8595 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:42.502788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a5df930-34b4-497f-a2b4-9978f1ca8595 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:42.570888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0a5df930-34b4-497f-a2b4-9978f1ca8595 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:42.574488 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:42.579647 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0a5df930-34b4-497f-a2b4-9978f1ca8595 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1245 microversion: 2.1 time: 0.099784 Jun 28 12:16:42.580212 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 508/1035] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:42 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:43.601936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5cd077cb-44e3-4cd4-8b59-d4816cc4f1f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:43.603224 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5cd077cb-44e3-4cd4-8b59-d4816cc4f1f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:43.614629 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5cd077cb-44e3-4cd4-8b59-d4816cc4f1f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:43.615391 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5cd077cb-44e3-4cd4-8b59-d4816cc4f1f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:43.616654 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5cd077cb-44e3-4cd4-8b59-d4816cc4f1f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:43.617426 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5cd077cb-44e3-4cd4-8b59-d4816cc4f1f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:43.680159 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-5cd077cb-44e3-4cd4-8b59-d4816cc4f1f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:43.688032 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5cd077cb-44e3-4cd4-8b59-d4816cc4f1f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1245 microversion: 2.1 time: 0.092776 Jun 28 12:16:43.688591 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 528/1036] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:43 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:44.705845 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9a0b2478-44cb-4fdf-a00b-1a2a56109112 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:44.706427 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9a0b2478-44cb-4fdf-a00b-1a2a56109112 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:44.715354 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a0b2478-44cb-4fdf-a00b-1a2a56109112 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:44.715812 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a0b2478-44cb-4fdf-a00b-1a2a56109112 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:44.716590 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a0b2478-44cb-4fdf-a00b-1a2a56109112 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:44.717093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a0b2478-44cb-4fdf-a00b-1a2a56109112 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:44.784005 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9a0b2478-44cb-4fdf-a00b-1a2a56109112 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:44.793916 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9a0b2478-44cb-4fdf-a00b-1a2a56109112 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1301 microversion: 2.1 time: 0.092289 Jun 28 12:16:44.794550 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 509/1037] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:44 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:45.811494 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d4f5818f-5438-4cfb-bded-8cf2483e42b6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:45.812049 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d4f5818f-5438-4cfb-bded-8cf2483e42b6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:45.818799 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4f5818f-5438-4cfb-bded-8cf2483e42b6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:45.819279 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4f5818f-5438-4cfb-bded-8cf2483e42b6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:45.820039 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4f5818f-5438-4cfb-bded-8cf2483e42b6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:45.820470 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d4f5818f-5438-4cfb-bded-8cf2483e42b6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:46.020039 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d4f5818f-5438-4cfb-bded-8cf2483e42b6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:46.035499 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d4f5818f-5438-4cfb-bded-8cf2483e42b6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1367 microversion: 2.1 time: 0.228160 Jun 28 12:16:46.036084 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 529/1038] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:45 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:46.339398 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-dcd72f65-adae-48b8-b5a6-a6598c36d708 req-9136df4d-34e4-4907-85e9-92155b8efb96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34bd04f-17f4-401e-a0d3-0bdf9e21df19", "tag": "19553999-7942-4a3e-981f-0634ca7c172b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:46.375173 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-dcd72f65-adae-48b8-b5a6-a6598c36d708 req-9136df4d-34e4-4907-85e9-92155b8efb96 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:46.378226 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-dcd72f65-adae-48b8-b5a6-a6598c36d708 req-9136df4d-34e4-4907-85e9-92155b8efb96 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:46.413538 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-dcd72f65-adae-48b8-b5a6-a6598c36d708 req-9136df4d-34e4-4907-85e9-92155b8efb96 service nova] Creating event network-changed:19553999-7942-4a3e-981f-0634ca7c172b for instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 on hv-cinder-84795 Jun 28 12:16:46.421291 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-dcd72f65-adae-48b8-b5a6-a6598c36d708 req-9136df4d-34e4-4907-85e9-92155b8efb96 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089263 Jun 28 12:16:46.422079 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 510/1039] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:47.053376 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2c8bf6b9-4e5f-4d6a-8eca-730db5c26d6f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:47.055133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2c8bf6b9-4e5f-4d6a-8eca-730db5c26d6f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:47.063074 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c8bf6b9-4e5f-4d6a-8eca-730db5c26d6f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:47.063739 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c8bf6b9-4e5f-4d6a-8eca-730db5c26d6f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:47.064727 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c8bf6b9-4e5f-4d6a-8eca-730db5c26d6f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:47.065503 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2c8bf6b9-4e5f-4d6a-8eca-730db5c26d6f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:47.247090 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2c8bf6b9-4e5f-4d6a-8eca-730db5c26d6f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:47.256645 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2c8bf6b9-4e5f-4d6a-8eca-730db5c26d6f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1367 microversion: 2.1 time: 0.207417 Jun 28 12:16:47.257598 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 530/1040] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:47 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:48.276341 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3d516272-144a-43b0-aea7-d58fb4252e3b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:48.278430 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3d516272-144a-43b0-aea7-d58fb4252e3b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:48.285270 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d516272-144a-43b0-aea7-d58fb4252e3b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:48.285808 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d516272-144a-43b0-aea7-d58fb4252e3b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:48.286662 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d516272-144a-43b0-aea7-d58fb4252e3b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:48.287172 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3d516272-144a-43b0-aea7-d58fb4252e3b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:48.438536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3d516272-144a-43b0-aea7-d58fb4252e3b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:48.449636 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3d516272-144a-43b0-aea7-d58fb4252e3b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1367 microversion: 2.1 time: 0.178558 Jun 28 12:16:48.450315 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 511/1041] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:48 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:49.467956 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cea43ea3-0f4f-45e0-b4a8-555f813dfadd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:49.469646 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cea43ea3-0f4f-45e0-b4a8-555f813dfadd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:49.478860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cea43ea3-0f4f-45e0-b4a8-555f813dfadd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:49.479931 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cea43ea3-0f4f-45e0-b4a8-555f813dfadd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:49.480988 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cea43ea3-0f4f-45e0-b4a8-555f813dfadd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:49.481620 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cea43ea3-0f4f-45e0-b4a8-555f813dfadd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:49.513530 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:49.711693 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cea43ea3-0f4f-45e0-b4a8-555f813dfadd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:49.721989 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cea43ea3-0f4f-45e0-b4a8-555f813dfadd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1367 microversion: 2.1 time: 0.257935 Jun 28 12:16:49.723623 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 531/1042] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:49 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:49.857711 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2168f4c5-489d-4328-a409-2c50197ae8e4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:49.858924 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2168f4c5-489d-4328-a409-2c50197ae8e4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:49.864339 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-4af9bd45-4727-4bec-a919-136684b03304 req-85067a72-b924-46ad-abaa-d9396a6325b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca1cbbba-49fd-4642-850d-b38e9dd57dd1", "tag": "f866ebc7-18e6-4ceb-b17b-1bd22be179a3"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:49.866276 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2168f4c5-489d-4328-a409-2c50197ae8e4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:49.867104 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2168f4c5-489d-4328-a409-2c50197ae8e4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:49.869381 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2168f4c5-489d-4328-a409-2c50197ae8e4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:49.870170 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2168f4c5-489d-4328-a409-2c50197ae8e4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:49.883820 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-4af9bd45-4727-4bec-a919-136684b03304 req-85067a72-b924-46ad-abaa-d9396a6325b0 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:49.884445 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-4af9bd45-4727-4bec-a919-136684b03304 req-85067a72-b924-46ad-abaa-d9396a6325b0 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:49.906559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2168f4c5-489d-4328-a409-2c50197ae8e4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:16:49.911031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-4af9bd45-4727-4bec-a919-136684b03304 req-85067a72-b924-46ad-abaa-d9396a6325b0 service nova] Creating event network-changed:f866ebc7-18e6-4ceb-b17b-1bd22be179a3 for instance ca1cbbba-49fd-4642-850d-b38e9dd57dd1 on hv-cinder-84795 Jun 28 12:16:49.923605 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-4af9bd45-4727-4bec-a919-136684b03304 req-85067a72-b924-46ad-abaa-d9396a6325b0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064919 Jun 28 12:16:49.925251 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 532/1043] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:16:50.111616 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2168f4c5-489d-4328-a409-2c50197ae8e4 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 204 len: 0 microversion: 2.1 time: 0.258237 Jun 28 12:16:50.113230 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 512/1044] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:16:49 2022] DELETE /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:16:50.122722 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-50e7110d-2d0d-4d01-8a7b-0a51766b9e30 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:50.124046 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-50e7110d-2d0d-4d01-8a7b-0a51766b9e30 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:50.137982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-50e7110d-2d0d-4d01-8a7b-0a51766b9e30 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:50.138478 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-50e7110d-2d0d-4d01-8a7b-0a51766b9e30 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:50.139303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-50e7110d-2d0d-4d01-8a7b-0a51766b9e30 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:50.139716 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-50e7110d-2d0d-4d01-8a7b-0a51766b9e30 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:50.193751 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:50.210163 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=10 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:50.378994 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-50e7110d-2d0d-4d01-8a7b-0a51766b9e30 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:50.392252 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-50e7110d-2d0d-4d01-8a7b-0a51766b9e30 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1577 microversion: 2.1 time: 0.272398 Jun 28 12:16:50.396955 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 533/1045] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:50 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1577 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:50.740951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-22e1aa84-cd48-4d1a-a945-6164b790e4a6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:50.741255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-22e1aa84-cd48-4d1a-a945-6164b790e4a6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:50.743585 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:50.762743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22e1aa84-cd48-4d1a-a945-6164b790e4a6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:50.763353 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22e1aa84-cd48-4d1a-a945-6164b790e4a6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:50.764427 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22e1aa84-cd48-4d1a-a945-6164b790e4a6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:50.764983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22e1aa84-cd48-4d1a-a945-6164b790e4a6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:50.942781 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-22e1aa84-cd48-4d1a-a945-6164b790e4a6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:50.951473 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-22e1aa84-cd48-4d1a-a945-6164b790e4a6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1367 microversion: 2.1 time: 0.215481 Jun 28 12:16:50.952671 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 513/1046] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:50 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:51.412026 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b0e85b0c-de85-4a67-89a5-c4f0b1f361b6 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:51.412624 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b0e85b0c-de85-4a67-89a5-c4f0b1f361b6 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:51.420726 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b0e85b0c-de85-4a67-89a5-c4f0b1f361b6 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:51.421211 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b0e85b0c-de85-4a67-89a5-c4f0b1f361b6 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:51.421984 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b0e85b0c-de85-4a67-89a5-c4f0b1f361b6 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:51.422411 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b0e85b0c-de85-4a67-89a5-c4f0b1f361b6 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:51.754794 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-b0e85b0c-de85-4a67-89a5-c4f0b1f361b6 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:51.764232 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b0e85b0c-de85-4a67-89a5-c4f0b1f361b6 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1577 microversion: 2.1 time: 0.356380 Jun 28 12:16:51.764963 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 534/1047] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:51 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1577 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:51.969726 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-33a5a620-95a1-4be9-91f0-36320cfa0b8e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:51.970308 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-33a5a620-95a1-4be9-91f0-36320cfa0b8e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:51.977431 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33a5a620-95a1-4be9-91f0-36320cfa0b8e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:51.977890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33a5a620-95a1-4be9-91f0-36320cfa0b8e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:51.978680 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33a5a620-95a1-4be9-91f0-36320cfa0b8e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:51.979119 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33a5a620-95a1-4be9-91f0-36320cfa0b8e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:52.136766 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-33a5a620-95a1-4be9-91f0-36320cfa0b8e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:52.146179 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-33a5a620-95a1-4be9-91f0-36320cfa0b8e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1367 microversion: 2.1 time: 0.180564 Jun 28 12:16:52.146957 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 514/1048] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:51 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:16:52.791324 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ae140feb-239b-4217-99ef-e85e7a429518 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:52.793240 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ae140feb-239b-4217-99ef-e85e7a429518 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:52.800322 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae140feb-239b-4217-99ef-e85e7a429518 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:52.801155 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae140feb-239b-4217-99ef-e85e7a429518 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:52.802145 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae140feb-239b-4217-99ef-e85e7a429518 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:52.802770 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ae140feb-239b-4217-99ef-e85e7a429518 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:53.015777 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-4f73b5b2-bb4d-40c1-bd63-3cc17ff10e70 req-2367e096-a569-420f-a09a-54ebe25c4495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca1cbbba-49fd-4642-850d-b38e9dd57dd1", "name": "network-vif-deleted", "tag": "f866ebc7-18e6-4ceb-b17b-1bd22be179a3"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:53.036051 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4f73b5b2-bb4d-40c1-bd63-3cc17ff10e70 req-2367e096-a569-420f-a09a-54ebe25c4495 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:53.037325 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4f73b5b2-bb4d-40c1-bd63-3cc17ff10e70 req-2367e096-a569-420f-a09a-54ebe25c4495 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:53.053884 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ae140feb-239b-4217-99ef-e85e7a429518 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:53.065905 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-4f73b5b2-bb4d-40c1-bd63-3cc17ff10e70 req-2367e096-a569-420f-a09a-54ebe25c4495 service nova] Creating event network-vif-deleted:f866ebc7-18e6-4ceb-b17b-1bd22be179a3 for instance ca1cbbba-49fd-4642-850d-b38e9dd57dd1 on hv-cinder-84795 Jun 28 12:16:53.069727 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ae140feb-239b-4217-99ef-e85e7a429518 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 200 len: 1459 microversion: 2.1 time: 0.282655 Jun 28 12:16:53.070904 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 535/1049] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:52 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 1459 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:53.077587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-4f73b5b2-bb4d-40c1-bd63-3cc17ff10e70 req-2367e096-a569-420f-a09a-54ebe25c4495 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067704 Jun 28 12:16:53.081478 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 515/1050] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:53.163816 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ec366991-5a2f-44fc-9f6a-37075d0beda9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:53.164931 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ec366991-5a2f-44fc-9f6a-37075d0beda9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:53.172654 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ec366991-5a2f-44fc-9f6a-37075d0beda9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:53.173445 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ec366991-5a2f-44fc-9f6a-37075d0beda9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:53.174616 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ec366991-5a2f-44fc-9f6a-37075d0beda9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:53.175287 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ec366991-5a2f-44fc-9f6a-37075d0beda9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:53.333048 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ec366991-5a2f-44fc-9f6a-37075d0beda9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:53.342569 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ec366991-5a2f-44fc-9f6a-37075d0beda9 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1367 microversion: 2.1 time: 0.183086 Jun 28 12:16:53.343371 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 536/1051] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:53 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:54.095118 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-35f17ef5-c437-4fb9-98eb-3889618efa61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:54.099107 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-35f17ef5-c437-4fb9-98eb-3889618efa61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: ca1cbbba-49fd-4642-850d-b38e9dd57dd1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:54.123663 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35f17ef5-c437-4fb9-98eb-3889618efa61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:54.128183 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35f17ef5-c437-4fb9-98eb-3889618efa61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:54.130316 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35f17ef5-c437-4fb9-98eb-3889618efa61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:54.131060 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35f17ef5-c437-4fb9-98eb-3889618efa61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:54.166935 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-35f17ef5-c437-4fb9-98eb-3889618efa61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] HTTP exception thrown: Instance ca1cbbba-49fd-4642-850d-b38e9dd57dd1 could not be found. Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-35f17ef5-c437-4fb9-98eb-3889618efa61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Request method failure captured: Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 HTTP/1.1 Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu6TPkyDoQDpQA0MtA9LR9_EgxFhSkUHquhjJKI9zi6VeD6zzaRBGURBas0KoAf_Ql0E3AaSSd8ZnMXILkrhjUuLRgfbyH9CQv45qZ6QGt0YUqBClpMDCHRclB7exGeK2f_l-3SwhpepN7_ncoMMxnMuwMmEezWVpBfdBoMWrVc_eLc Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 7235a9c7eff24e0e94900ec2abc92ae5 Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestVolumeBootPattern-592497969 Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:16:54.170549 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7235a9c7eff24e0e94900ec2abc92ae5"}]}] Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestVolumeBootPattern-592497969 Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 7235a9c7eff24e0e94900ec2abc92ae5 Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestVolumeBootPattern-592497969 Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-TestVolumeBootPattern-592497969-project Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: 9f56095d6bac4f108a73790ac9004f3b Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestVolumeBootPattern-592497969-project Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance ca1cbbba-49fd-4642-850d-b38e9dd57dd1 could not be found. Jun 28 12:16:54.172312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'ca1cbbba-49fd-4642-850d-b38e9dd57dd1'} Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca1cbbba-49fd-4642-850d-b38e9dd57dd1 could not be found. Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:16:54.173181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca1cbbba-49fd-4642-850d-b38e9dd57dd1 could not be found. Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca1cbbba-49fd-4642-850d-b38e9dd57dd1 could not be found. Jun 28 12:16:54.174732 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:16:54.177922 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-35f17ef5-c437-4fb9-98eb-3889618efa61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Returning 404 to user: Instance ca1cbbba-49fd-4642-850d-b38e9dd57dd1 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:16:54.179901 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-35f17ef5-c437-4fb9-98eb-3889618efa61 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1" status: 404 len: 111 microversion: 2.1 time: 0.094778 Jun 28 12:16:54.186908 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 516/1052] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:54 2022] GET /compute/v2.1/servers/ca1cbbba-49fd-4642-850d-b38e9dd57dd1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:16:54.360925 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-995ee6d7-461f-4669-bd74-7a4ce69f2c06 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:54.361669 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-995ee6d7-461f-4669-bd74-7a4ce69f2c06 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:54.375314 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-995ee6d7-461f-4669-bd74-7a4ce69f2c06 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:54.377280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-995ee6d7-461f-4669-bd74-7a4ce69f2c06 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:54.385558 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-995ee6d7-461f-4669-bd74-7a4ce69f2c06 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:54.386510 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-995ee6d7-461f-4669-bd74-7a4ce69f2c06 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:54.544450 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a16ab35b-7a62-465c-b60a-3d5cf4ebbcf1 req-1ac4d327-7af0-4818-b35b-5b1e0c0292a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34bd04f-17f4-401e-a0d3-0bdf9e21df19", "name": "network-vif-plugged", "status": "completed", "tag": "19553999-7942-4a3e-981f-0634ca7c172b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:54.559098 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a16ab35b-7a62-465c-b60a-3d5cf4ebbcf1 req-1ac4d327-7af0-4818-b35b-5b1e0c0292a7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:54.560655 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a16ab35b-7a62-465c-b60a-3d5cf4ebbcf1 req-1ac4d327-7af0-4818-b35b-5b1e0c0292a7 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:54.574794 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-995ee6d7-461f-4669-bd74-7a4ce69f2c06 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:54.579802 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a16ab35b-7a62-465c-b60a-3d5cf4ebbcf1 req-1ac4d327-7af0-4818-b35b-5b1e0c0292a7 service nova] Creating event network-vif-plugged:19553999-7942-4a3e-981f-0634ca7c172b for instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 on hv-cinder-84795 Jun 28 12:16:54.589747 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-995ee6d7-461f-4669-bd74-7a4ce69f2c06 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1367 microversion: 2.1 time: 0.232495 Jun 28 12:16:54.590433 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a16ab35b-7a62-465c-b60a-3d5cf4ebbcf1 req-1ac4d327-7af0-4818-b35b-5b1e0c0292a7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049567 Jun 28 12:16:54.591370 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 517/1054] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:54.591580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 537/1054] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:54 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:55.609106 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-32a40c61-d448-487f-89d7-3314d5c716d4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:55.609812 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-32a40c61-d448-487f-89d7-3314d5c716d4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:55.617709 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32a40c61-d448-487f-89d7-3314d5c716d4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:55.618374 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32a40c61-d448-487f-89d7-3314d5c716d4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:55.619311 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32a40c61-d448-487f-89d7-3314d5c716d4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:55.619956 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32a40c61-d448-487f-89d7-3314d5c716d4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:55.786704 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-32a40c61-d448-487f-89d7-3314d5c716d4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:55.795705 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-32a40c61-d448-487f-89d7-3314d5c716d4 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1367 microversion: 2.1 time: 0.191699 Jun 28 12:16:55.798521 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 518/1055] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:55 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:56.815842 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e6f89826-a577-4c76-8abe-429e0ab7ecec tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:56.816454 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e6f89826-a577-4c76-8abe-429e0ab7ecec tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:56.824075 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6f89826-a577-4c76-8abe-429e0ab7ecec tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:56.824783 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6f89826-a577-4c76-8abe-429e0ab7ecec tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:56.825754 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6f89826-a577-4c76-8abe-429e0ab7ecec tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:56.826354 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e6f89826-a577-4c76-8abe-429e0ab7ecec tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:57.037471 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e6f89826-a577-4c76-8abe-429e0ab7ecec tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:57.050724 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e6f89826-a577-4c76-8abe-429e0ab7ecec tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1556 microversion: 2.1 time: 0.238460 Jun 28 12:16:57.052101 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 538/1056] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:56 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:57.069689 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-13f875c7-e2ed-482b-8d5c-6dd0d6be82b1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:57.070315 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-13f875c7-e2ed-482b-8d5c-6dd0d6be82b1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:57.080599 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13f875c7-e2ed-482b-8d5c-6dd0d6be82b1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:57.081207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13f875c7-e2ed-482b-8d5c-6dd0d6be82b1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:57.082030 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13f875c7-e2ed-482b-8d5c-6dd0d6be82b1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:57.082504 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13f875c7-e2ed-482b-8d5c-6dd0d6be82b1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:57.200639 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-13f875c7-e2ed-482b-8d5c-6dd0d6be82b1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134716 Jun 28 12:16:57.201334 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 519/1057] 10.222.0.55 () {58 vars in 1274 bytes} [Tue Jun 28 12:16:57 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:57.657754 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d02ebae1-04dd-41b4-b1ef-f6c339360251 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:57.658347 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d02ebae1-04dd-41b4-b1ef-f6c339360251 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:57.665793 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-d11aa0b1-e6d9-4da6-a8c9-9cef35f9b0be req-029366e5-5f45-4f7f-adc4-e83e67be1ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8576de0f-1773-4ebb-90d3-f8a05811e2e3", "tag": "63943ce2-4a0b-467c-adf0-ba864f08ad3c"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:57.686907 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:57.692340 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d11aa0b1-e6d9-4da6-a8c9-9cef35f9b0be req-029366e5-5f45-4f7f-adc4-e83e67be1ff4 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:57.692340 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d11aa0b1-e6d9-4da6-a8c9-9cef35f9b0be req-029366e5-5f45-4f7f-adc4-e83e67be1ff4 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:57.702223 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d02ebae1-04dd-41b4-b1ef-f6c339360251 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:57.702806 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d02ebae1-04dd-41b4-b1ef-f6c339360251 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:57.704005 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d02ebae1-04dd-41b4-b1ef-f6c339360251 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:57.704597 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d02ebae1-04dd-41b4-b1ef-f6c339360251 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:57.738406 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-d11aa0b1-e6d9-4da6-a8c9-9cef35f9b0be req-029366e5-5f45-4f7f-adc4-e83e67be1ff4 service nova] Creating event network-changed:63943ce2-4a0b-467c-adf0-ba864f08ad3c for instance 8576de0f-1773-4ebb-90d3-f8a05811e2e3 on hv-cinder-84795 Jun 28 12:16:57.745682 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d02ebae1-04dd-41b4-b1ef-f6c339360251 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:16:57.750953 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-d11aa0b1-e6d9-4da6-a8c9-9cef35f9b0be req-029366e5-5f45-4f7f-adc4-e83e67be1ff4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089231 Jun 28 12:16:57.751894 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 520/1058] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:16:57.893444 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d02ebae1-04dd-41b4-b1ef-f6c339360251 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 204 len: 0 microversion: 2.1 time: 0.245480 Jun 28 12:16:57.894975 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 539/1059] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:16:57 2022] DELETE /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:16:57.903851 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9fd4e460-8c90-40af-b7af-ccde34abb527 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:57.904554 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9fd4e460-8c90-40af-b7af-ccde34abb527 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:57.912099 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9fd4e460-8c90-40af-b7af-ccde34abb527 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:57.913140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9fd4e460-8c90-40af-b7af-ccde34abb527 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:57.913922 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9fd4e460-8c90-40af-b7af-ccde34abb527 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:57.914540 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9fd4e460-8c90-40af-b7af-ccde34abb527 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:58.365244 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9fd4e460-8c90-40af-b7af-ccde34abb527 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:58.382724 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9fd4e460-8c90-40af-b7af-ccde34abb527 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1578 microversion: 2.1 time: 0.483284 Jun 28 12:16:58.383312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 521/1060] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:57 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1578 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:58.999039 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-798996fb-fdce-4542-88b1-4c18a2c1c8d3 req-8d4b699a-b4a2-4538-a4d8-28d678b7b5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34bd04f-17f4-401e-a0d3-0bdf9e21df19", "tag": "19553999-7942-4a3e-981f-0634ca7c172b"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:59.019714 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-798996fb-fdce-4542-88b1-4c18a2c1c8d3 req-8d4b699a-b4a2-4538-a4d8-28d678b7b5c2 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:59.020090 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-798996fb-fdce-4542-88b1-4c18a2c1c8d3 req-8d4b699a-b4a2-4538-a4d8-28d678b7b5c2 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:59.036550 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-798996fb-fdce-4542-88b1-4c18a2c1c8d3 req-8d4b699a-b4a2-4538-a4d8-28d678b7b5c2 service nova] Creating event network-changed:19553999-7942-4a3e-981f-0634ca7c172b for instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 on hv-cinder-84795 Jun 28 12:16:59.056098 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-798996fb-fdce-4542-88b1-4c18a2c1c8d3 req-8d4b699a-b4a2-4538-a4d8-28d678b7b5c2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063675 Jun 28 12:16:59.057032 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 540/1061] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:16:59.404188 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-af8dc1b5-1bf4-46f7-bbd7-86da499c731a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:16:59.405489 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-af8dc1b5-1bf4-46f7-bbd7-86da499c731a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:16:59.420200 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af8dc1b5-1bf4-46f7-bbd7-86da499c731a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:59.423029 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af8dc1b5-1bf4-46f7-bbd7-86da499c731a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:59.425258 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af8dc1b5-1bf4-46f7-bbd7-86da499c731a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:59.425965 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af8dc1b5-1bf4-46f7-bbd7-86da499c731a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:59.764993 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-af8dc1b5-1bf4-46f7-bbd7-86da499c731a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f56095d6bac4f108a73790ac9004f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7235a9c7eff24e0e94900ec2abc92ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:16:59.782323 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-af8dc1b5-1bf4-46f7-bbd7-86da499c731a tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 200 len: 1459 microversion: 2.1 time: 0.384623 Jun 28 12:16:59.784603 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 522/1062] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:16:59 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 1459 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:16:59.799636 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-0fa25c40-e65e-4572-8fbc-d5228e05a3f1 req-4a4826fe-3160-4174-8b0b-1bfc38573fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8576de0f-1773-4ebb-90d3-f8a05811e2e3", "name": "network-vif-deleted", "tag": "63943ce2-4a0b-467c-adf0-ba864f08ad3c"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:16:59.818497 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-0fa25c40-e65e-4572-8fbc-d5228e05a3f1 req-4a4826fe-3160-4174-8b0b-1bfc38573fac service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:16:59.818958 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-0fa25c40-e65e-4572-8fbc-d5228e05a3f1 req-4a4826fe-3160-4174-8b0b-1bfc38573fac service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:16:59.848332 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-0fa25c40-e65e-4572-8fbc-d5228e05a3f1 req-4a4826fe-3160-4174-8b0b-1bfc38573fac service nova] Creating event network-vif-deleted:63943ce2-4a0b-467c-adf0-ba864f08ad3c for instance 8576de0f-1773-4ebb-90d3-f8a05811e2e3 on hv-cinder-84795 Jun 28 12:16:59.857974 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-0fa25c40-e65e-4572-8fbc-d5228e05a3f1 req-4a4826fe-3160-4174-8b0b-1bfc38573fac service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063674 Jun 28 12:16:59.859827 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 541/1063] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:17:00.799303 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-08125272-dadf-4558-81da-cc4b50b40c46 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:17:00.802015 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-08125272-dadf-4558-81da-cc4b50b40c46 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 8576de0f-1773-4ebb-90d3-f8a05811e2e3] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:17:00.822161 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08125272-dadf-4558-81da-cc4b50b40c46 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:17:00.822800 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08125272-dadf-4558-81da-cc4b50b40c46 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:17:00.823962 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08125272-dadf-4558-81da-cc4b50b40c46 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:17:00.824394 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-08125272-dadf-4558-81da-cc4b50b40c46 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:17:00.841258 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-08125272-dadf-4558-81da-cc4b50b40c46 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] HTTP exception thrown: Instance 8576de0f-1773-4ebb-90d3-f8a05811e2e3 could not be found. Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-08125272-dadf-4558-81da-cc4b50b40c46 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Request method failure captured: Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 HTTP/1.1 Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu6TPkyDoQDpQA0MtA9LR9_EgxFhSkUHquhjJKI9zi6VeD6zzaRBGURBas0KoAf_Ql0E3AaSSd8ZnMXILkrhjUuLRgfbyH9CQv45qZ6QGt0YUqBClpMDCHRclB7exGeK2f_l-3SwhpepN7_ncoMMxnMuwMmEezWVpBfdBoMWrVc_eLc Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 7235a9c7eff24e0e94900ec2abc92ae5 Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestVolumeBootPattern-592497969 Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:17:00.843457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7235a9c7eff24e0e94900ec2abc92ae5"}]}] Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestVolumeBootPattern-592497969 Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 7235a9c7eff24e0e94900ec2abc92ae5 Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestVolumeBootPattern-592497969 Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-TestVolumeBootPattern-592497969-project Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: 9f56095d6bac4f108a73790ac9004f3b Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestVolumeBootPattern-592497969-project Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 8576de0f-1773-4ebb-90d3-f8a05811e2e3 could not be found. Jun 28 12:17:00.845123 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '8576de0f-1773-4ebb-90d3-f8a05811e2e3'} Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8576de0f-1773-4ebb-90d3-f8a05811e2e3 could not be found. Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:17:00.845968 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8576de0f-1773-4ebb-90d3-f8a05811e2e3 could not be found. Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8576de0f-1773-4ebb-90d3-f8a05811e2e3 could not be found. Jun 28 12:17:00.847331 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:17:00.850000 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-08125272-dadf-4558-81da-cc4b50b40c46 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Returning 404 to user: Instance 8576de0f-1773-4ebb-90d3-f8a05811e2e3 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:17:00.851380 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-08125272-dadf-4558-81da-cc4b50b40c46 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3" status: 404 len: 111 microversion: 2.1 time: 0.056382 Jun 28 12:17:00.852871 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 523/1064] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:17:00 2022] GET /compute/v2.1/servers/8576de0f-1773-4ebb-90d3-f8a05811e2e3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:17:01.786758 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cecc793e-ce2d-4300-856f-021219c2a522 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:17:01.787575 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cecc793e-ce2d-4300-856f-021219c2a522 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:17:01.795158 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cecc793e-ce2d-4300-856f-021219c2a522 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:17:01.795600 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cecc793e-ce2d-4300-856f-021219c2a522 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:17:01.796358 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cecc793e-ce2d-4300-856f-021219c2a522 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:17:01.796846 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cecc793e-ce2d-4300-856f-021219c2a522 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:17:01.811594 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-cecc793e-ce2d-4300-856f-021219c2a522 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] HTTP exception thrown: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cecc793e-ce2d-4300-856f-021219c2a522 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Request method failure captured: Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 HTTP/1.1 Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuu6TPkyDoQDpQA0MtA9LR9_EgxFhSkUHquhjJKI9zi6VeD6zzaRBGURBas0KoAf_Ql0E3AaSSd8ZnMXILkrhjUuLRgfbyH9CQv45qZ6QGt0YUqBClpMDCHRclB7exGeK2f_l-3SwhpepN7_ncoMMxnMuwMmEezWVpBfdBoMWrVc_eLc Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 7235a9c7eff24e0e94900ec2abc92ae5 Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-TestVolumeBootPattern-592497969 Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:17:01.813365 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7235a9c7eff24e0e94900ec2abc92ae5"}]}] Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-TestVolumeBootPattern-592497969 Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 7235a9c7eff24e0e94900ec2abc92ae5 Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-TestVolumeBootPattern-592497969 Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-TestVolumeBootPattern-592497969-project Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 9f56095d6bac4f108a73790ac9004f3b Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-TestVolumeBootPattern-592497969-project Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:17:01.814860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '7d3b43f9-d11c-431b-ae03-a6d4e7186040'} Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:17:01.815656 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:17:01.816976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:17:01.819069 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cecc793e-ce2d-4300-856f-021219c2a522 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Returning 404 to user: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:17:01.820273 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cecc793e-ce2d-4300-856f-021219c2a522 tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 404 len: 111 microversion: 2.1 time: 0.037892 Jun 28 12:17:01.821191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 542/1065] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:17:01 2022] DELETE /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:17:01.830380 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7a5c7809-a803-4e76-a252-eedc0a7e072b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:17:01.831610 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7a5c7809-a803-4e76-a252-eedc0a7e072b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] [instance: 7d3b43f9-d11c-431b-ae03-a6d4e7186040] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:17:01.838462 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7a5c7809-a803-4e76-a252-eedc0a7e072b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:17:01.838982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7a5c7809-a803-4e76-a252-eedc0a7e072b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:17:01.839977 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7a5c7809-a803-4e76-a252-eedc0a7e072b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:17:01.840397 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7a5c7809-a803-4e76-a252-eedc0a7e072b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:17:01.855062 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-7a5c7809-a803-4e76-a252-eedc0a7e072b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] HTTP exception thrown: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7a5c7809-a803-4e76-a252-eedc0a7e072b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Request method failure captured: Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 HTTP/1.1 Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuu6TPkyDoQDpQA0MtA9LR9_EgxFhSkUHquhjJKI9zi6VeD6zzaRBGURBas0KoAf_Ql0E3AaSSd8ZnMXILkrhjUuLRgfbyH9CQv45qZ6QGt0YUqBClpMDCHRclB7exGeK2f_l-3SwhpepN7_ncoMMxnMuwMmEezWVpBfdBoMWrVc_eLc Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 7235a9c7eff24e0e94900ec2abc92ae5 Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestVolumeBootPattern-592497969 Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:17:01.856548 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_7235a9c7eff24e0e94900ec2abc92ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7235a9c7eff24e0e94900ec2abc92ae5"}]}] Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestVolumeBootPattern-592497969 Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 7235a9c7eff24e0e94900ec2abc92ae5 Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestVolumeBootPattern-592497969 Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-TestVolumeBootPattern-592497969-project Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: 9f56095d6bac4f108a73790ac9004f3b Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestVolumeBootPattern-592497969-project Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:17:01.858103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '7d3b43f9-d11c-431b-ae03-a6d4e7186040'} Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:17:01.858888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. Jun 28 12:17:01.860253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:17:01.861517 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7a5c7809-a803-4e76-a252-eedc0a7e072b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Returning 404 to user: Instance 7d3b43f9-d11c-431b-ae03-a6d4e7186040 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:17:01.861517 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7a5c7809-a803-4e76-a252-eedc0a7e072b tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040" status: 404 len: 111 microversion: 2.1 time: 0.031946 Jun 28 12:17:01.861517 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 524/1066] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:17:01 2022] GET /compute/v2.1/servers/7d3b43f9-d11c-431b-ae03-a6d4e7186040 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 12:17:03.194636 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a9a38c2c-3160-4798-bcae-5cf0e118b34e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] Calling method '.version_select at 0x7f3932c2b9d0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:17:03.215884 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a9a38c2c-3160-4798-bcae-5cf0e118b34e tempest-TestVolumeBootPattern-592497969 tempest-TestVolumeBootPattern-592497969-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1512622342" status: 202 len: 0 microversion: 2.1 time: 0.025095 Jun 28 12:17:03.216499 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 543/1067] 10.222.0.55 () {58 vars in 1262 bytes} [Tue Jun 28 12:17:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1512622342 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:18:02.057749 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:18:02.058691 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Tue Jun 28 12:18:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:18:14.704814 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:14.705946 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:14.712615 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9a588e0d-551f-47de-a5c5-59d020f813cb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:14.713445 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9a588e0d-551f-47de-a5c5-59d020f813cb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:14.723109 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a588e0d-551f-47de-a5c5-59d020f813cb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:14.723629 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a588e0d-551f-47de-a5c5-59d020f813cb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:14.724451 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a588e0d-551f-47de-a5c5-59d020f813cb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:14.724933 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a588e0d-551f-47de-a5c5-59d020f813cb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:14.749730 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9a588e0d-551f-47de-a5c5-59d020f813cb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19/ips" status: 200 len: 148 microversion: 2.1 time: 0.048371 Jun 28 12:18:14.750405 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 525/1068] 10.222.0.55 () {58 vars in 1247 bytes} [Tue Jun 28 12:18:14 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:18:14.758982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:14.759702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:14.764702 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7ad8e8a-eb6d-48cf-96db-f58640e42d94 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13396a0b-4793-4cbe-b4ed-9f6b8c96c403"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:18:14.765871 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a7ad8e8a-eb6d-48cf-96db-f58640e42d94 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:14.777419 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7ad8e8a-eb6d-48cf-96db-f58640e42d94 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:14.777870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7ad8e8a-eb6d-48cf-96db-f58640e42d94 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:14.778638 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7ad8e8a-eb6d-48cf-96db-f58640e42d94 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:14.779068 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a7ad8e8a-eb6d-48cf-96db-f58640e42d94 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:14.865710 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-a7ad8e8a-eb6d-48cf-96db-f58640e42d94 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Invalid volume: volume 13396a0b-4793-4cbe-b4ed-9f6b8c96c403 is already attached to instances: 023a3ea3-0028-4022-9f3f-0617a2b29e26 Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7ad8e8a-eb6d-48cf-96db-f58640e42d94 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: POST /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19/os-volume_attachments HTTP/1.1 Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 74 Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:18:14.867607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {"volumeAttachment": {"volumeId": "13396a0b-4793-4cbe-b4ed-9f6b8c96c403"}} Jun 28 12:18:14.869769 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Invalid volume: volume 13396a0b-4793-4cbe-b4ed-9f6b8c96c403 is already attached to instances: 023a3ea3-0028-4022-9f3f-0617a2b29e26 Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'server_id': 'd34bd04f-17f4-401e-a0d3-0bdf9e21df19', 'body': {'volumeAttachment': {'volumeId': '13396a0b-4793-4cbe-b4ed-9f6b8c96c403'}}} Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 13396a0b-4793-4cbe-b4ed-9f6b8c96c403 is already attached to instances: 023a3ea3-0028-4022-9f3f-0617a2b29e26 Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:18:14.871133 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 13396a0b-4793-4cbe-b4ed-9f6b8c96c403 is already attached to instances: 023a3ea3-0028-4022-9f3f-0617a2b29e26 Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:18:14.873329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:18:14.875864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:18:14.875864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:18:14.875864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:18:14.875864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 13396a0b-4793-4cbe-b4ed-9f6b8c96c403 is already attached to instances: 023a3ea3-0028-4022-9f3f-0617a2b29e26 Jun 28 12:18:14.875864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:18:14.875864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a7ad8e8a-eb6d-48cf-96db-f58640e42d94 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 400 to user: Invalid volume: volume 13396a0b-4793-4cbe-b4ed-9f6b8c96c403 is already attached to instances: 023a3ea3-0028-4022-9f3f-0617a2b29e26 {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:18:14.875864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a7ad8e8a-eb6d-48cf-96db-f58640e42d94 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111934 Jun 28 12:18:14.875864 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 544/1069] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:18:14 2022] POST /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 28 12:18:14.880604 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3baddd99-1949-4b17-8f2c-e43b75502b17 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:14.881138 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3baddd99-1949-4b17-8f2c-e43b75502b17 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:14.887871 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3baddd99-1949-4b17-8f2c-e43b75502b17 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:14.888309 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3baddd99-1949-4b17-8f2c-e43b75502b17 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:14.889111 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3baddd99-1949-4b17-8f2c-e43b75502b17 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:14.889542 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3baddd99-1949-4b17-8f2c-e43b75502b17 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:14.915559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3baddd99-1949-4b17-8f2c-e43b75502b17 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:18:15.003269 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3baddd99-1949-4b17-8f2c-e43b75502b17 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 204 len: 0 microversion: 2.1 time: 0.126345 Jun 28 12:18:15.004278 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 526/1070] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:18:14 2022] DELETE /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:18:15.013058 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-eac109bb-b7c8-4eed-8bba-9dcdca542755 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:15.013659 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-eac109bb-b7c8-4eed-8bba-9dcdca542755 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:15.021103 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eac109bb-b7c8-4eed-8bba-9dcdca542755 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:15.021543 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eac109bb-b7c8-4eed-8bba-9dcdca542755 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:15.022391 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eac109bb-b7c8-4eed-8bba-9dcdca542755 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:15.022820 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-eac109bb-b7c8-4eed-8bba-9dcdca542755 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:15.170785 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-eac109bb-b7c8-4eed-8bba-9dcdca542755 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:15.179744 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-eac109bb-b7c8-4eed-8bba-9dcdca542755 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1680 microversion: 2.1 time: 0.170800 Jun 28 12:18:15.180310 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 545/1071] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:15 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:16.204323 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-49fe0813-ad70-41e0-a400-7040a0458901 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:16.205552 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-49fe0813-ad70-41e0-a400-7040a0458901 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:16.216488 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49fe0813-ad70-41e0-a400-7040a0458901 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:16.217294 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49fe0813-ad70-41e0-a400-7040a0458901 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:16.218543 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49fe0813-ad70-41e0-a400-7040a0458901 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:16.219756 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49fe0813-ad70-41e0-a400-7040a0458901 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:16.371065 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-49fe0813-ad70-41e0-a400-7040a0458901 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:16.379388 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-49fe0813-ad70-41e0-a400-7040a0458901 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1680 microversion: 2.1 time: 0.183470 Jun 28 12:18:16.379962 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 527/1072] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:16 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:17.397452 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a85ebda1-df5b-4e3d-8657-acf8dbfc8c18 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:17.398085 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a85ebda1-df5b-4e3d-8657-acf8dbfc8c18 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:17.400498 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82a381c4-9f4e-4668-ba78-7fcfb002569d] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 28 12:18:17.406016 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a85ebda1-df5b-4e3d-8657-acf8dbfc8c18 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:17.406483 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a85ebda1-df5b-4e3d-8657-acf8dbfc8c18 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:17.407259 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a85ebda1-df5b-4e3d-8657-acf8dbfc8c18 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:17.407777 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a85ebda1-df5b-4e3d-8657-acf8dbfc8c18 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:17.540644 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a85ebda1-df5b-4e3d-8657-acf8dbfc8c18 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:17.548986 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a85ebda1-df5b-4e3d-8657-acf8dbfc8c18 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1680 microversion: 2.1 time: 0.155510 Jun 28 12:18:17.549585 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 546/1073] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:17 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:17.885046 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-4850793c-08cf-4deb-9e92-cc6bba100e62 req-23cf2e83-9b04-4c26-8d42-69841c233f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34bd04f-17f4-401e-a0d3-0bdf9e21df19", "name": "network-vif-deleted", "tag": "19553999-7942-4a3e-981f-0634ca7c172b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:18:17.894537 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4850793c-08cf-4deb-9e92-cc6bba100e62 req-23cf2e83-9b04-4c26-8d42-69841c233f19 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:17.894982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4850793c-08cf-4deb-9e92-cc6bba100e62 req-23cf2e83-9b04-4c26-8d42-69841c233f19 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:17.906916 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-4850793c-08cf-4deb-9e92-cc6bba100e62 req-23cf2e83-9b04-4c26-8d42-69841c233f19 service nova] Creating event network-vif-deleted:19553999-7942-4a3e-981f-0634ca7c172b for instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 on hv-cinder-84795 Jun 28 12:18:17.912268 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-4850793c-08cf-4deb-9e92-cc6bba100e62 req-23cf2e83-9b04-4c26-8d42-69841c233f19 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031102 Jun 28 12:18:17.913096 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 528/1074] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:18:18.567654 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-bbe3a567-d076-4b24-bfac-4dab04b896dc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:18.568294 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-bbe3a567-d076-4b24-bfac-4dab04b896dc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:18.579462 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] [82a381c4-9f4e-4668-ba78-7fcfb002569d] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 41178. Jun 28 12:18:18.583529 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbe3a567-d076-4b24-bfac-4dab04b896dc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:18.583978 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbe3a567-d076-4b24-bfac-4dab04b896dc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:18.585005 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbe3a567-d076-4b24-bfac-4dab04b896dc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:18.585775 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbe3a567-d076-4b24-bfac-4dab04b896dc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:18.622672 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbe3a567-d076-4b24-bfac-4dab04b896dc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:18.623396 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-bbe3a567-d076-4b24-bfac-4dab04b896dc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:18.623849 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-bbe3a567-d076-4b24-bfac-4dab04b896dc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lazy-loading 'fault' on Instance uuid d34bd04f-17f4-401e-a0d3-0bdf9e21df19 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:18:18.670185 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-bbe3a567-d076-4b24-bfac-4dab04b896dc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:18.678407 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-bbe3a567-d076-4b24-bfac-4dab04b896dc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 200 len: 1331 microversion: 2.1 time: 0.114775 Jun 28 12:18:18.679346 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 547/1075] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:18 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:19.697120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3173cfd1-3a1d-45ff-b270-06ac229bffe7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:19.697810 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3173cfd1-3a1d-45ff-b270-06ac229bffe7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:19.705218 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3173cfd1-3a1d-45ff-b270-06ac229bffe7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:19.705666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3173cfd1-3a1d-45ff-b270-06ac229bffe7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:19.706415 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3173cfd1-3a1d-45ff-b270-06ac229bffe7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:19.706843 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3173cfd1-3a1d-45ff-b270-06ac229bffe7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:19.720143 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-3173cfd1-3a1d-45ff-b270-06ac229bffe7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3173cfd1-3a1d-45ff-b270-06ac229bffe7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 HTTP/1.1 Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:18:19.721791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:18:19.723368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'd34bd04f-17f4-401e-a0d3-0bdf9e21df19'} Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:18:19.724233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:18:19.725688 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:18:19.726944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3173cfd1-3a1d-45ff-b270-06ac229bffe7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:18:19.726944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3173cfd1-3a1d-45ff-b270-06ac229bffe7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 404 len: 111 microversion: 2.1 time: 0.030792 Jun 28 12:18:19.726944 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 529/1076] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:19 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:18:19.732819 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2e08f6cc-2b68-47df-91bb-a74735abd9cc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '.version_select at 0x7f3932dbaaf0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:19.755915 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2e08f6cc-2b68-47df-91bb-a74735abd9cc tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322755310" status: 202 len: 0 microversion: 2.1 time: 0.027157 Jun 28 12:18:19.756686 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 548/1077] 10.222.0.55 () {58 vars in 1220 bytes} [Tue Jun 28 12:18:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322755310 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:18:20.441494 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6b5b81c0-8064-4a2c-adc5-0dd2f2330809 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:20.442015 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6b5b81c0-8064-4a2c-adc5-0dd2f2330809 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:20.448735 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b5b81c0-8064-4a2c-adc5-0dd2f2330809 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:20.449219 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b5b81c0-8064-4a2c-adc5-0dd2f2330809 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:20.449985 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b5b81c0-8064-4a2c-adc5-0dd2f2330809 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:20.450424 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6b5b81c0-8064-4a2c-adc5-0dd2f2330809 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:20.547219 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-6b5b81c0-8064-4a2c-adc5-0dd2f2330809 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lazy-loading 'services' on Instance uuid 023a3ea3-0028-4022-9f3f-0617a2b29e26 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:18:20.630135 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6b5b81c0-8064-4a2c-adc5-0dd2f2330809 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/os-volume_attachments/13396a0b-4793-4cbe-b4ed-9f6b8c96c403" status: 202 len: 0 microversion: 2.1 time: 0.192460 Jun 28 12:18:20.630786 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 530/1078] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:18:20 2022] DELETE /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/os-volume_attachments/13396a0b-4793-4cbe-b4ed-9f6b8c96c403 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:18:20.639431 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-336fb171-4558-4e52-91d1-946e48cf104f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:20.640434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-336fb171-4558-4e52-91d1-946e48cf104f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:20.647675 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-336fb171-4558-4e52-91d1-946e48cf104f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:20.648114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-336fb171-4558-4e52-91d1-946e48cf104f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:20.648923 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-336fb171-4558-4e52-91d1-946e48cf104f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:20.649354 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-336fb171-4558-4e52-91d1-946e48cf104f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:20.680078 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-336fb171-4558-4e52-91d1-946e48cf104f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044727 Jun 28 12:18:20.680647 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 549/1079] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:18:20 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:18:21.694016 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c8fa2afc-145d-4c64-91df-c835282752dd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:21.695086 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c8fa2afc-145d-4c64-91df-c835282752dd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:21.701842 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8fa2afc-145d-4c64-91df-c835282752dd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:21.702288 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8fa2afc-145d-4c64-91df-c835282752dd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:21.703040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8fa2afc-145d-4c64-91df-c835282752dd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:21.703471 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8fa2afc-145d-4c64-91df-c835282752dd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:21.732680 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c8fa2afc-145d-4c64-91df-c835282752dd tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043666 Jun 28 12:18:21.733255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 531/1080] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:18:21 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 12:18:21.802040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5f0c5a17-7223-431f-b7fc-64ad2af69583 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:21.802587 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5f0c5a17-7223-431f-b7fc-64ad2af69583 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:21.809498 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f0c5a17-7223-431f-b7fc-64ad2af69583 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:21.809945 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f0c5a17-7223-431f-b7fc-64ad2af69583 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:21.810703 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f0c5a17-7223-431f-b7fc-64ad2af69583 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:21.811139 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f0c5a17-7223-431f-b7fc-64ad2af69583 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:21.836746 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5f0c5a17-7223-431f-b7fc-64ad2af69583 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Going to try to terminate instance {{(pid=117888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:18:21.920623 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5f0c5a17-7223-431f-b7fc-64ad2af69583 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 204 len: 0 microversion: 2.1 time: 0.122266 Jun 28 12:18:21.921583 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 550/1081] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:18:21 2022] DELETE /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:18:21.930462 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-643f85b6-a36a-4ede-b167-f3afbfc5a907 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:21.931082 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-643f85b6-a36a-4ede-b167-f3afbfc5a907 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:21.937407 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-643f85b6-a36a-4ede-b167-f3afbfc5a907 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:21.937870 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-643f85b6-a36a-4ede-b167-f3afbfc5a907 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:21.938637 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-643f85b6-a36a-4ede-b167-f3afbfc5a907 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:21.939124 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-643f85b6-a36a-4ede-b167-f3afbfc5a907 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:22.076261 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-643f85b6-a36a-4ede-b167-f3afbfc5a907 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:22.084442 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-643f85b6-a36a-4ede-b167-f3afbfc5a907 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1682 microversion: 2.1 time: 0.157956 Jun 28 12:18:22.085034 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 532/1082] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:21 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:23.103191 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ed2f4ef9-2ea7-4783-b1fb-4d3ac60d6bda tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:23.103809 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ed2f4ef9-2ea7-4783-b1fb-4d3ac60d6bda tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:23.111123 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed2f4ef9-2ea7-4783-b1fb-4d3ac60d6bda tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:23.111574 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed2f4ef9-2ea7-4783-b1fb-4d3ac60d6bda tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:23.112441 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed2f4ef9-2ea7-4783-b1fb-4d3ac60d6bda tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:23.112783 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ed2f4ef9-2ea7-4783-b1fb-4d3ac60d6bda tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:23.248509 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ed2f4ef9-2ea7-4783-b1fb-4d3ac60d6bda tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:23.256678 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ed2f4ef9-2ea7-4783-b1fb-4d3ac60d6bda tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1682 microversion: 2.1 time: 0.158346 Jun 28 12:18:23.257247 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 551/1083] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:23 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:24.274117 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5da48af5-2915-4496-bdea-2e004f70ef5a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:24.274744 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5da48af5-2915-4496-bdea-2e004f70ef5a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:24.281537 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5da48af5-2915-4496-bdea-2e004f70ef5a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:24.281999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5da48af5-2915-4496-bdea-2e004f70ef5a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:24.283387 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5da48af5-2915-4496-bdea-2e004f70ef5a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:24.283758 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5da48af5-2915-4496-bdea-2e004f70ef5a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:24.486431 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5da48af5-2915-4496-bdea-2e004f70ef5a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:24.494054 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5da48af5-2915-4496-bdea-2e004f70ef5a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 200 len: 1682 microversion: 2.1 time: 0.223859 Jun 28 12:18:24.494791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 533/1084] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:24 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:24.821527 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-9c1af8a0-915e-43c6-9c15-97a49ab38f21 req-eee00934-2664-4326-8b00-55a5659094ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023a3ea3-0028-4022-9f3f-0617a2b29e26", "name": "network-vif-deleted", "tag": "95067e1f-36da-4d0e-ae1b-39e3c455020d"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:18:24.831244 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-9c1af8a0-915e-43c6-9c15-97a49ab38f21 req-eee00934-2664-4326-8b00-55a5659094ad service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:24.831674 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-9c1af8a0-915e-43c6-9c15-97a49ab38f21 req-eee00934-2664-4326-8b00-55a5659094ad service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:24.843498 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-9c1af8a0-915e-43c6-9c15-97a49ab38f21 req-eee00934-2664-4326-8b00-55a5659094ad service nova] Creating event network-vif-deleted:95067e1f-36da-4d0e-ae1b-39e3c455020d for instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 on hv-cinder-84795 Jun 28 12:18:24.849261 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-9c1af8a0-915e-43c6-9c15-97a49ab38f21 req-eee00934-2664-4326-8b00-55a5659094ad service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031536 Jun 28 12:18:24.849856 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 552/1085] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:18:25.512177 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-17b8e22a-5035-47a3-87e7-133abccd0b9f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:25.513106 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-17b8e22a-5035-47a3-87e7-133abccd0b9f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:25.521265 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17b8e22a-5035-47a3-87e7-133abccd0b9f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:25.521719 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17b8e22a-5035-47a3-87e7-133abccd0b9f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:25.522785 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17b8e22a-5035-47a3-87e7-133abccd0b9f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:25.523564 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17b8e22a-5035-47a3-87e7-133abccd0b9f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:25.538543 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-17b8e22a-5035-47a3-87e7-133abccd0b9f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-17b8e22a-5035-47a3-87e7-133abccd0b9f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 HTTP/1.1 Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:18:25.540221 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:18:25.542067 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '023a3ea3-0028-4022-9f3f-0617a2b29e26'} Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:18:25.542950 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:18:25.544516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:18:25.545932 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-17b8e22a-5035-47a3-87e7-133abccd0b9f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:18:25.545932 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-17b8e22a-5035-47a3-87e7-133abccd0b9f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 404 len: 111 microversion: 2.1 time: 0.033462 Jun 28 12:18:25.545932 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 534/1086] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:25 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:18:25.551926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3072ff11-72bf-46fb-b41a-25af5f29e628 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '.version_select at 0x7f3932c2b8b0>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:25.572321 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3072ff11-72bf-46fb-b41a-25af5f29e628 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979653189" status: 202 len: 0 microversion: 2.1 time: 0.025207 Jun 28 12:18:25.573042 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 553/1087] 10.222.0.55 () {58 vars in 1220 bytes} [Tue Jun 28 12:18:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979653189 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:18:26.218692 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bed791ea-4419-4d67-b6e5-8d093f0a5be7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: .version_select at 0x7f3938108a60>, body: {"keypair": {"name": "tempest-keypair-100122563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHzLUcsAnnci2V63WWEbdDuU1Je4ZPn74Ro2UvOHdaA4oOz1s3raPOoGNzw+GsNcyA48PAdgy2NoL4tHVdt8XKO6gbt/V6ilF0Io1N01gXq+gPMfNmgm6K/OLfUBnS7jA=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:18:26.233708 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-bed791ea-4419-4d67-b6e5-8d093f0a5be7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:18:26.237823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-bed791ea-4419-4d67-b6e5-8d093f0a5be7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for user f2f9826f53b44e1bbaf721d66de1356b and project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:18:26.262636 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bed791ea-4419-4d67-b6e5-8d093f0a5be7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047879 Jun 28 12:18:26.263201 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 535/1088] 10.222.0.55 () {60 vars in 1158 bytes} [Tue Jun 28 12:18:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:18:27.595241 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2048939208", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ab7246a-96e7-4fc8-aac1-d967c789fbd7"}], "security_groups": [{"name": "tempest-securitygroup--1256594192"}], "key_name": "tempest-keypair-100122563", "user_data": "}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:18:27.702899 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] validate_networks() for [('7ab7246a-96e7-4fc8-aac1-d967c789fbd7', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:18:28.082380 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:18:28.082947 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:18:28.083623 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:18:28.084185 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:18:28.084766 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:18:28.097466 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:28.097910 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:28.098704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:28.099137 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:28.116748 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:18:28.121255 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for user f2f9826f53b44e1bbaf721d66de1356b and project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:18:28.133948 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:18:28.136322 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:18:28.187576 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0d9341e5-d434-4f9f-82e0-b939005c065b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597343 Jun 28 12:18:28.188187 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 554/1089] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:18:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:18:28.199597 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-388b5805-dbaf-45e1-9dca-017b1a76150d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:28.200194 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-388b5805-dbaf-45e1-9dca-017b1a76150d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:28.254506 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-388b5805-dbaf-45e1-9dca-017b1a76150d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:28.262452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-388b5805-dbaf-45e1-9dca-017b1a76150d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1241 microversion: 2.1 time: 0.067147 Jun 28 12:18:28.263060 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 536/1090] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:28 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:18:29.281286 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6ce560d6-0025-4db4-97cb-f1be4a465210 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:29.282034 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6ce560d6-0025-4db4-97cb-f1be4a465210 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:29.289891 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ce560d6-0025-4db4-97cb-f1be4a465210 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:29.290339 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ce560d6-0025-4db4-97cb-f1be4a465210 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:29.291108 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ce560d6-0025-4db4-97cb-f1be4a465210 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:29.291537 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6ce560d6-0025-4db4-97cb-f1be4a465210 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:29.357328 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6ce560d6-0025-4db4-97cb-f1be4a465210 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:29.365543 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6ce560d6-0025-4db4-97cb-f1be4a465210 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1299 microversion: 2.1 time: 0.088569 Jun 28 12:18:29.366183 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 555/1091] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:29 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:30.382699 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b49487e1-6ac9-4dba-8f88-7ff8d8174cc6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:30.383286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b49487e1-6ac9-4dba-8f88-7ff8d8174cc6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:30.390484 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b49487e1-6ac9-4dba-8f88-7ff8d8174cc6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:30.390931 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b49487e1-6ac9-4dba-8f88-7ff8d8174cc6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:30.391698 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b49487e1-6ac9-4dba-8f88-7ff8d8174cc6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:30.392371 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b49487e1-6ac9-4dba-8f88-7ff8d8174cc6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:30.622819 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b49487e1-6ac9-4dba-8f88-7ff8d8174cc6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:30.631969 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b49487e1-6ac9-4dba-8f88-7ff8d8174cc6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1367 microversion: 2.1 time: 0.253101 Jun 28 12:18:30.632612 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 537/1092] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:30 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:30.759888 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-beb9906c-2902-4b3b-83f7-2210be6d23ed req-3b183e04-cdd7-4a13-b758-b531b265b86b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a", "tag": "cb2dac50-f6e7-4477-a200-a94a8fe061d3"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:18:30.771783 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-beb9906c-2902-4b3b-83f7-2210be6d23ed req-3b183e04-cdd7-4a13-b758-b531b265b86b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:30.772705 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-beb9906c-2902-4b3b-83f7-2210be6d23ed req-3b183e04-cdd7-4a13-b758-b531b265b86b service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:30.790016 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-beb9906c-2902-4b3b-83f7-2210be6d23ed req-3b183e04-cdd7-4a13-b758-b531b265b86b service nova] Creating event network-changed:cb2dac50-f6e7-4477-a200-a94a8fe061d3 for instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a on hv-cinder-84795 Jun 28 12:18:30.796387 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-beb9906c-2902-4b3b-83f7-2210be6d23ed req-3b183e04-cdd7-4a13-b758-b531b265b86b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040538 Jun 28 12:18:30.797615 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 556/1093] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:18:31.652072 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-13a33acb-f294-41a4-8440-ddac486a0429 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:31.653103 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-13a33acb-f294-41a4-8440-ddac486a0429 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:31.664565 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13a33acb-f294-41a4-8440-ddac486a0429 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:31.665411 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13a33acb-f294-41a4-8440-ddac486a0429 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:31.666731 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13a33acb-f294-41a4-8440-ddac486a0429 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:31.667431 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-13a33acb-f294-41a4-8440-ddac486a0429 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:31.810975 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-13a33acb-f294-41a4-8440-ddac486a0429 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:31.819007 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-13a33acb-f294-41a4-8440-ddac486a0429 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1367 microversion: 2.1 time: 0.173526 Jun 28 12:18:31.819577 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 538/1094] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:31 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:32.836650 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cfc29583-f614-4a0f-b61e-bd164d489f65 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:32.837361 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cfc29583-f614-4a0f-b61e-bd164d489f65 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:32.844618 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cfc29583-f614-4a0f-b61e-bd164d489f65 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:32.845475 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cfc29583-f614-4a0f-b61e-bd164d489f65 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:32.846285 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cfc29583-f614-4a0f-b61e-bd164d489f65 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:32.846704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cfc29583-f614-4a0f-b61e-bd164d489f65 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:32.992004 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-cfc29583-f614-4a0f-b61e-bd164d489f65 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:33.003939 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cfc29583-f614-4a0f-b61e-bd164d489f65 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1367 microversion: 2.1 time: 0.171299 Jun 28 12:18:33.004824 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 557/1095] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:32 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:34.026292 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e85e4120-5438-49f1-a606-e651e02d05e6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:34.027209 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e85e4120-5438-49f1-a606-e651e02d05e6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:34.036470 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e85e4120-5438-49f1-a606-e651e02d05e6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:34.036939 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e85e4120-5438-49f1-a606-e651e02d05e6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:34.037777 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e85e4120-5438-49f1-a606-e651e02d05e6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:34.038211 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e85e4120-5438-49f1-a606-e651e02d05e6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:34.178452 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e85e4120-5438-49f1-a606-e651e02d05e6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:34.186294 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e85e4120-5438-49f1-a606-e651e02d05e6 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1367 microversion: 2.1 time: 0.167495 Jun 28 12:18:34.186856 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 539/1096] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:34 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:35.203325 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0bbb50b3-eb14-4bdb-9fd8-3cb8efcfda90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:35.204066 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0bbb50b3-eb14-4bdb-9fd8-3cb8efcfda90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:35.210768 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bbb50b3-eb14-4bdb-9fd8-3cb8efcfda90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:35.211213 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bbb50b3-eb14-4bdb-9fd8-3cb8efcfda90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:35.211990 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bbb50b3-eb14-4bdb-9fd8-3cb8efcfda90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:35.212423 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0bbb50b3-eb14-4bdb-9fd8-3cb8efcfda90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:35.351090 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0bbb50b3-eb14-4bdb-9fd8-3cb8efcfda90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:35.362035 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0bbb50b3-eb14-4bdb-9fd8-3cb8efcfda90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1367 microversion: 2.1 time: 0.163064 Jun 28 12:18:35.362574 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 558/1097] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:35 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:36.387825 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-186c9d8f-f481-465f-9ba0-5606dba21b4e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:36.388710 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-186c9d8f-f481-465f-9ba0-5606dba21b4e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:36.400219 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-186c9d8f-f481-465f-9ba0-5606dba21b4e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:36.400982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-186c9d8f-f481-465f-9ba0-5606dba21b4e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:36.402297 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-186c9d8f-f481-465f-9ba0-5606dba21b4e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:36.403024 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-186c9d8f-f481-465f-9ba0-5606dba21b4e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:36.539624 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-186c9d8f-f481-465f-9ba0-5606dba21b4e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:36.547727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-186c9d8f-f481-465f-9ba0-5606dba21b4e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1367 microversion: 2.1 time: 0.166586 Jun 28 12:18:36.548414 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 540/1098] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:36 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:36.674003 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-086a659d-ed84-4646-b1a8-5bd247f265f9 req-38dfd76f-aea1-4d87-9c27-4dc335bb2b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a", "name": "network-vif-plugged", "status": "completed", "tag": "cb2dac50-f6e7-4477-a200-a94a8fe061d3"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:18:36.683203 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-086a659d-ed84-4646-b1a8-5bd247f265f9 req-38dfd76f-aea1-4d87-9c27-4dc335bb2b31 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:36.683713 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-086a659d-ed84-4646-b1a8-5bd247f265f9 req-38dfd76f-aea1-4d87-9c27-4dc335bb2b31 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:36.695759 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-086a659d-ed84-4646-b1a8-5bd247f265f9 req-38dfd76f-aea1-4d87-9c27-4dc335bb2b31 service nova] Creating event network-vif-plugged:cb2dac50-f6e7-4477-a200-a94a8fe061d3 for instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a on hv-cinder-84795 Jun 28 12:18:36.700684 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-086a659d-ed84-4646-b1a8-5bd247f265f9 req-38dfd76f-aea1-4d87-9c27-4dc335bb2b31 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030687 Jun 28 12:18:36.701877 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 559/1099] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:18:37.567441 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-63ccec5d-d191-48e9-ab4c-91e4b14cec2b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:37.568050 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-63ccec5d-d191-48e9-ab4c-91e4b14cec2b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:37.575003 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63ccec5d-d191-48e9-ab4c-91e4b14cec2b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:37.575448 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63ccec5d-d191-48e9-ab4c-91e4b14cec2b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:37.576611 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63ccec5d-d191-48e9-ab4c-91e4b14cec2b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:37.577319 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63ccec5d-d191-48e9-ab4c-91e4b14cec2b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:37.718247 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-63ccec5d-d191-48e9-ab4c-91e4b14cec2b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:37.726466 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-63ccec5d-d191-48e9-ab4c-91e4b14cec2b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1367 microversion: 2.1 time: 0.164365 Jun 28 12:18:37.727027 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 541/1100] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:37 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:38.744317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:38.745096 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:38.750855 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9798bedf-8cac-47e3-95eb-34d5476928c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:38.751560 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9798bedf-8cac-47e3-95eb-34d5476928c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:38.760845 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9798bedf-8cac-47e3-95eb-34d5476928c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:38.760845 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9798bedf-8cac-47e3-95eb-34d5476928c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:38.761190 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9798bedf-8cac-47e3-95eb-34d5476928c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:38.761459 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9798bedf-8cac-47e3-95eb-34d5476928c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:38.904295 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9798bedf-8cac-47e3-95eb-34d5476928c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:38.912291 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9798bedf-8cac-47e3-95eb-34d5476928c0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1556 microversion: 2.1 time: 0.169481 Jun 28 12:18:38.912879 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 560/1101] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:38 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:38.928572 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0e2807fe-a872-4836-93a7-fea9f28aafa8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:38.929120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0e2807fe-a872-4836-93a7-fea9f28aafa8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:38.931055 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:38.937333 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e2807fe-a872-4836-93a7-fea9f28aafa8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:38.937727 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e2807fe-a872-4836-93a7-fea9f28aafa8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:38.938499 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e2807fe-a872-4836-93a7-fea9f28aafa8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:38.938948 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e2807fe-a872-4836-93a7-fea9f28aafa8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:39.021206 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0e2807fe-a872-4836-93a7-fea9f28aafa8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096527 Jun 28 12:18:39.021793 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 542/1102] 10.222.0.55 () {58 vars in 1274 bytes} [Tue Jun 28 12:18:38 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:18:40.239822 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-af305e0e-e9c3-4e9f-ae65-6c04e9962c2b req-5992b6e9-a6b1-4c85-ade6-a6a7ccd8aeba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a", "tag": "cb2dac50-f6e7-4477-a200-a94a8fe061d3"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:18:40.249115 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-af305e0e-e9c3-4e9f-ae65-6c04e9962c2b req-5992b6e9-a6b1-4c85-ade6-a6a7ccd8aeba service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:40.249658 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-af305e0e-e9c3-4e9f-ae65-6c04e9962c2b req-5992b6e9-a6b1-4c85-ade6-a6a7ccd8aeba service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:40.261626 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-af305e0e-e9c3-4e9f-ae65-6c04e9962c2b req-5992b6e9-a6b1-4c85-ade6-a6a7ccd8aeba service nova] Creating event network-changed:cb2dac50-f6e7-4477-a200-a94a8fe061d3 for instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a on hv-cinder-84795 Jun 28 12:18:40.266528 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-af305e0e-e9c3-4e9f-ae65-6c04e9962c2b req-5992b6e9-a6b1-4c85-ade6-a6a7ccd8aeba service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030498 Jun 28 12:18:40.267502 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 561/1103] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:18:44.060958 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f28b54db-eba7-4be5-9396-9103fc898bd0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:18:44.061833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f28b54db-eba7-4be5-9396-9103fc898bd0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:44.069782 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f28b54db-eba7-4be5-9396-9103fc898bd0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:44.070237 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f28b54db-eba7-4be5-9396-9103fc898bd0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:44.071008 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f28b54db-eba7-4be5-9396-9103fc898bd0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:44.071451 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f28b54db-eba7-4be5-9396-9103fc898bd0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:44.094937 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-f28b54db-eba7-4be5-9396-9103fc898bd0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lazy-loading 'flavor' on Instance uuid 3086f12b-7edc-4ff3-a17d-def512b5679a {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:18:44.098678 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:44.174788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f28b54db-eba7-4be5-9396-9103fc898bd0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "POST /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a/action" status: 202 len: 0 microversion: 2.1 time: 0.121310 Jun 28 12:18:44.175467 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 543/1104] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:18:44 2022] POST /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:18:44.184932 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-54a439f5-7dee-4d16-aec6-421d20cab603 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:44.185645 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-54a439f5-7dee-4d16-aec6-421d20cab603 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:44.192867 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-54a439f5-7dee-4d16-aec6-421d20cab603 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:44.193370 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-54a439f5-7dee-4d16-aec6-421d20cab603 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:44.194248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-54a439f5-7dee-4d16-aec6-421d20cab603 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:44.194704 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-54a439f5-7dee-4d16-aec6-421d20cab603 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:44.338055 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-54a439f5-7dee-4d16-aec6-421d20cab603 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:44.345753 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-54a439f5-7dee-4d16-aec6-421d20cab603 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.165735 Jun 28 12:18:44.346303 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 562/1105] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:44 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:45.369554 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2b5a4ae2-d66a-47e3-810f-234ec24778d2 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:45.370704 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2b5a4ae2-d66a-47e3-810f-234ec24778d2 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:45.373843 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:45.381765 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b5a4ae2-d66a-47e3-810f-234ec24778d2 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:45.382251 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b5a4ae2-d66a-47e3-810f-234ec24778d2 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:45.383024 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b5a4ae2-d66a-47e3-810f-234ec24778d2 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:45.383465 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b5a4ae2-d66a-47e3-810f-234ec24778d2 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:45.536508 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2b5a4ae2-d66a-47e3-810f-234ec24778d2 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:45.548762 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2b5a4ae2-d66a-47e3-810f-234ec24778d2 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.187176 Jun 28 12:18:45.550218 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 544/1106] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:45 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:46.574527 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e0b711a1-14bc-41c3-8cc6-c73359d0ad49 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:46.575300 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e0b711a1-14bc-41c3-8cc6-c73359d0ad49 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:46.578839 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:46.585065 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e0b711a1-14bc-41c3-8cc6-c73359d0ad49 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:46.585507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e0b711a1-14bc-41c3-8cc6-c73359d0ad49 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:46.586261 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e0b711a1-14bc-41c3-8cc6-c73359d0ad49 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:46.586720 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e0b711a1-14bc-41c3-8cc6-c73359d0ad49 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:46.590085 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:46.732795 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e0b711a1-14bc-41c3-8cc6-c73359d0ad49 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:46.741376 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e0b711a1-14bc-41c3-8cc6-c73359d0ad49 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.172088 Jun 28 12:18:46.741941 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 563/1107] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:46 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:47.762795 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6c348fbf-ed96-4bc8-9324-5ec6c83c9e57 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:47.763782 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6c348fbf-ed96-4bc8-9324-5ec6c83c9e57 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:47.776898 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c348fbf-ed96-4bc8-9324-5ec6c83c9e57 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:47.777169 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c348fbf-ed96-4bc8-9324-5ec6c83c9e57 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:47.778470 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c348fbf-ed96-4bc8-9324-5ec6c83c9e57 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:47.779187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c348fbf-ed96-4bc8-9324-5ec6c83c9e57 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:47.936611 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6c348fbf-ed96-4bc8-9324-5ec6c83c9e57 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:47.948358 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6c348fbf-ed96-4bc8-9324-5ec6c83c9e57 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.191946 Jun 28 12:18:47.949306 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 545/1108] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:47 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:48.970653 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-9a7d88ce-31ff-4b48-a66b-19f2b9e45260 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:48.971335 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-9a7d88ce-31ff-4b48-a66b-19f2b9e45260 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:48.979075 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a7d88ce-31ff-4b48-a66b-19f2b9e45260 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:48.979533 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a7d88ce-31ff-4b48-a66b-19f2b9e45260 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:48.980291 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a7d88ce-31ff-4b48-a66b-19f2b9e45260 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:48.980767 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-9a7d88ce-31ff-4b48-a66b-19f2b9e45260 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:49.120571 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-9a7d88ce-31ff-4b48-a66b-19f2b9e45260 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:49.130491 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-9a7d88ce-31ff-4b48-a66b-19f2b9e45260 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.166355 Jun 28 12:18:49.131069 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 564/1109] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:48 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:50.150459 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4ff6bf13-e724-4fd9-b643-117ba6beba93 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:50.151284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4ff6bf13-e724-4fd9-b643-117ba6beba93 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:50.160586 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ff6bf13-e724-4fd9-b643-117ba6beba93 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:50.161291 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ff6bf13-e724-4fd9-b643-117ba6beba93 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:50.162346 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ff6bf13-e724-4fd9-b643-117ba6beba93 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:50.162948 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ff6bf13-e724-4fd9-b643-117ba6beba93 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:50.309863 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4ff6bf13-e724-4fd9-b643-117ba6beba93 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:50.318065 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4ff6bf13-e724-4fd9-b643-117ba6beba93 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.173041 Jun 28 12:18:50.318636 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 546/1110] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:50 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:51.338849 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d3523764-bcea-49c9-b0cc-797ac617bdc6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:51.339512 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d3523764-bcea-49c9-b0cc-797ac617bdc6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:51.348418 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3523764-bcea-49c9-b0cc-797ac617bdc6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:51.348865 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3523764-bcea-49c9-b0cc-797ac617bdc6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:51.349660 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3523764-bcea-49c9-b0cc-797ac617bdc6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:51.350092 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d3523764-bcea-49c9-b0cc-797ac617bdc6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:51.503528 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-d3523764-bcea-49c9-b0cc-797ac617bdc6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:51.511519 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d3523764-bcea-49c9-b0cc-797ac617bdc6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.179084 Jun 28 12:18:51.512073 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 565/1111] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:51 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:52.533661 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4005eb5f-78b9-4468-b3c3-b9feef95f5e1 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:52.535413 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4005eb5f-78b9-4468-b3c3-b9feef95f5e1 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:52.546014 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4005eb5f-78b9-4468-b3c3-b9feef95f5e1 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:52.546778 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4005eb5f-78b9-4468-b3c3-b9feef95f5e1 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:52.548045 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4005eb5f-78b9-4468-b3c3-b9feef95f5e1 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:52.548780 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4005eb5f-78b9-4468-b3c3-b9feef95f5e1 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:52.687492 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4005eb5f-78b9-4468-b3c3-b9feef95f5e1 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:52.696124 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4005eb5f-78b9-4468-b3c3-b9feef95f5e1 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.169068 Jun 28 12:18:52.696689 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 547/1112] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:52 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:53.715861 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-98e5a06d-2b0a-4aab-ab86-3b9d8448d097 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:53.716502 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-98e5a06d-2b0a-4aab-ab86-3b9d8448d097 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:53.724813 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98e5a06d-2b0a-4aab-ab86-3b9d8448d097 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:53.725293 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98e5a06d-2b0a-4aab-ab86-3b9d8448d097 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:53.726054 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98e5a06d-2b0a-4aab-ab86-3b9d8448d097 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:53.726473 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-98e5a06d-2b0a-4aab-ab86-3b9d8448d097 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:53.872166 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-98e5a06d-2b0a-4aab-ab86-3b9d8448d097 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:53.884647 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-98e5a06d-2b0a-4aab-ab86-3b9d8448d097 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.172609 Jun 28 12:18:53.885422 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 566/1113] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:53 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:54.902587 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3a0be76a-6380-4686-b979-bf9db7cd5c7c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:54.903197 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3a0be76a-6380-4686-b979-bf9db7cd5c7c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:54.910075 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a0be76a-6380-4686-b979-bf9db7cd5c7c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:54.910520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a0be76a-6380-4686-b979-bf9db7cd5c7c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:54.911285 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a0be76a-6380-4686-b979-bf9db7cd5c7c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:54.911729 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a0be76a-6380-4686-b979-bf9db7cd5c7c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:55.050795 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3a0be76a-6380-4686-b979-bf9db7cd5c7c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:55.063140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3a0be76a-6380-4686-b979-bf9db7cd5c7c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.164204 Jun 28 12:18:55.064030 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 548/1114] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:54 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:56.083283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-19987f92-bab8-4b39-8aac-2cd04095bfe4 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:56.083866 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-19987f92-bab8-4b39-8aac-2cd04095bfe4 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:56.090907 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19987f92-bab8-4b39-8aac-2cd04095bfe4 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:56.091384 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19987f92-bab8-4b39-8aac-2cd04095bfe4 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:56.092127 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19987f92-bab8-4b39-8aac-2cd04095bfe4 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:56.092560 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-19987f92-bab8-4b39-8aac-2cd04095bfe4 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:56.234092 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-19987f92-bab8-4b39-8aac-2cd04095bfe4 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:56.242474 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-19987f92-bab8-4b39-8aac-2cd04095bfe4 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.163487 Jun 28 12:18:56.243040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 567/1115] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:56 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:57.268970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a2aef607-7c4b-4751-98d2-11d16278963a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:57.270064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a2aef607-7c4b-4751-98d2-11d16278963a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:57.281081 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2aef607-7c4b-4751-98d2-11d16278963a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:57.281837 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2aef607-7c4b-4751-98d2-11d16278963a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:57.283093 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2aef607-7c4b-4751-98d2-11d16278963a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:57.283834 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2aef607-7c4b-4751-98d2-11d16278963a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:57.428789 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a2aef607-7c4b-4751-98d2-11d16278963a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:57.437218 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a2aef607-7c4b-4751-98d2-11d16278963a tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1570 microversion: 2.1 time: 0.174647 Jun 28 12:18:57.437832 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 549/1116] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:57 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:57.455729 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-155fa2f4-48ef-4cc3-9583-426e3ce6f4c0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:18:57.456289 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-155fa2f4-48ef-4cc3-9583-426e3ce6f4c0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:57.464420 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-155fa2f4-48ef-4cc3-9583-426e3ce6f4c0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:57.464995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-155fa2f4-48ef-4cc3-9583-426e3ce6f4c0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:57.465846 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-155fa2f4-48ef-4cc3-9583-426e3ce6f4c0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:57.466283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-155fa2f4-48ef-4cc3-9583-426e3ce6f4c0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:57.554700 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-155fa2f4-48ef-4cc3-9583-426e3ce6f4c0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "POST /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a/action" status: 202 len: 0 microversion: 2.1 time: 0.102866 Jun 28 12:18:57.555244 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 568/1117] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Jun 28 12:18:57 2022] POST /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:18:57.563505 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f6de9f9f-cc6d-4d9e-abd6-722400bdad02 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:57.564140 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f6de9f9f-cc6d-4d9e-abd6-722400bdad02 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:57.571464 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6de9f9f-cc6d-4d9e-abd6-722400bdad02 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:57.572030 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6de9f9f-cc6d-4d9e-abd6-722400bdad02 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:57.572945 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6de9f9f-cc6d-4d9e-abd6-722400bdad02 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:57.573459 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6de9f9f-cc6d-4d9e-abd6-722400bdad02 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:57.726098 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f6de9f9f-cc6d-4d9e-abd6-722400bdad02 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:57.733905 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f6de9f9f-cc6d-4d9e-abd6-722400bdad02 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1518 microversion: 2.1 time: 0.174155 Jun 28 12:18:57.734485 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 550/1118] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:57 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:18:58.755202 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ef41a7b2-6470-46ff-9be5-b400c3806650 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:58.755795 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ef41a7b2-6470-46ff-9be5-b400c3806650 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:58.762671 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef41a7b2-6470-46ff-9be5-b400c3806650 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:58.763121 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef41a7b2-6470-46ff-9be5-b400c3806650 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:58.763888 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef41a7b2-6470-46ff-9be5-b400c3806650 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:58.764315 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef41a7b2-6470-46ff-9be5-b400c3806650 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:58.915877 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ef41a7b2-6470-46ff-9be5-b400c3806650 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:18:58.923417 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ef41a7b2-6470-46ff-9be5-b400c3806650 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1518 microversion: 2.1 time: 0.172809 Jun 28 12:18:58.923978 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 569/1119] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:58 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:18:59.946416 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e2583f1d-b6b5-4b53-a889-0f26ad242df7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:18:59.947239 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e2583f1d-b6b5-4b53-a889-0f26ad242df7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:18:59.958412 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2583f1d-b6b5-4b53-a889-0f26ad242df7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:59.958853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2583f1d-b6b5-4b53-a889-0f26ad242df7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:18:59.959617 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2583f1d-b6b5-4b53-a889-0f26ad242df7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:18:59.960052 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2583f1d-b6b5-4b53-a889-0f26ad242df7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:00.107625 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e2583f1d-b6b5-4b53-a889-0f26ad242df7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:00.115871 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e2583f1d-b6b5-4b53-a889-0f26ad242df7 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1518 microversion: 2.1 time: 0.177053 Jun 28 12:19:00.116446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 551/1120] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:18:59 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:00.710429 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-330adf69-3201-4953-a77e-ac49b44461d4 req-a3c0dc9c-de2d-48e9-9ab1-6d14c8c92fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3086f12b-7edc-4ff3-a17d-def512b5679a", "name": "network-vif-unplugged", "status": "completed", "tag": "21fbb702-a7b1-4182-9dee-00707b91284d"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:19:00.719918 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-330adf69-3201-4953-a77e-ac49b44461d4 req-a3c0dc9c-de2d-48e9-9ab1-6d14c8c92fdb service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:00.720363 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-330adf69-3201-4953-a77e-ac49b44461d4 req-a3c0dc9c-de2d-48e9-9ab1-6d14c8c92fdb service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:00.733396 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.compute.server_external_events [req-330adf69-3201-4953-a77e-ac49b44461d4 req-a3c0dc9c-de2d-48e9-9ab1-6d14c8c92fdb service nova] Unable to find a host for instance 3086f12b-7edc-4ff3-a17d-def512b5679a. Dropping event network-vif-unplugged {{(pid=117888) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 28 12:19:00.734288 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-330adf69-3201-4953-a77e-ac49b44461d4 req-a3c0dc9c-de2d-48e9-9ab1-6d14c8c92fdb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028064 Jun 28 12:19:00.734869 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 570/1121] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 28 12:19:01.134597 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-02e79a3a-3595-436d-a314-a49b88ebd309 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:01.135313 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-02e79a3a-3595-436d-a314-a49b88ebd309 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:01.142574 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02e79a3a-3595-436d-a314-a49b88ebd309 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:01.143028 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02e79a3a-3595-436d-a314-a49b88ebd309 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:01.144214 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02e79a3a-3595-436d-a314-a49b88ebd309 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:01.144516 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02e79a3a-3595-436d-a314-a49b88ebd309 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:01.301962 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-02e79a3a-3595-436d-a314-a49b88ebd309 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:01.309670 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-02e79a3a-3595-436d-a314-a49b88ebd309 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1518 microversion: 2.1 time: 0.179139 Jun 28 12:19:01.310209 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 552/1122] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:01 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:02.329514 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-787143df-863a-4d8a-be28-da2cc9ca31a8 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:02.330223 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-787143df-863a-4d8a-be28-da2cc9ca31a8 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:02.337283 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-787143df-863a-4d8a-be28-da2cc9ca31a8 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:02.337805 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-787143df-863a-4d8a-be28-da2cc9ca31a8 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:02.338675 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-787143df-863a-4d8a-be28-da2cc9ca31a8 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:02.339192 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-787143df-863a-4d8a-be28-da2cc9ca31a8 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:02.474870 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-787143df-863a-4d8a-be28-da2cc9ca31a8 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:02.482924 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-787143df-863a-4d8a-be28-da2cc9ca31a8 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1518 microversion: 2.1 time: 0.159137 Jun 28 12:19:02.483490 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 571/1123] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:02 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:03.505053 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5ff03694-c0d8-48dc-8369-4549263f0b59 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:03.505970 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5ff03694-c0d8-48dc-8369-4549263f0b59 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:03.517094 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ff03694-c0d8-48dc-8369-4549263f0b59 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:03.517824 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ff03694-c0d8-48dc-8369-4549263f0b59 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:03.519068 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ff03694-c0d8-48dc-8369-4549263f0b59 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:03.519782 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ff03694-c0d8-48dc-8369-4549263f0b59 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:03.758375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5ff03694-c0d8-48dc-8369-4549263f0b59 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:03.767649 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5ff03694-c0d8-48dc-8369-4549263f0b59 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.269406 Jun 28 12:19:03.772253 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 553/1124] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:03 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:04.789302 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-39532f68-1c9a-4ccd-bff3-e8e0461b99e0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:04.789969 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-39532f68-1c9a-4ccd-bff3-e8e0461b99e0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:04.797019 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39532f68-1c9a-4ccd-bff3-e8e0461b99e0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:04.797487 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39532f68-1c9a-4ccd-bff3-e8e0461b99e0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:04.798248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39532f68-1c9a-4ccd-bff3-e8e0461b99e0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:04.798675 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-39532f68-1c9a-4ccd-bff3-e8e0461b99e0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:04.941120 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-39532f68-1c9a-4ccd-bff3-e8e0461b99e0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:04.949350 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-39532f68-1c9a-4ccd-bff3-e8e0461b99e0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.166461 Jun 28 12:19:04.949924 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 572/1125] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:04 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:05.971312 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5c148d78-17ea-457f-870a-251d3b76a8e6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:05.972291 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5c148d78-17ea-457f-870a-251d3b76a8e6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:05.983351 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c148d78-17ea-457f-870a-251d3b76a8e6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:05.984115 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c148d78-17ea-457f-870a-251d3b76a8e6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:05.985462 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c148d78-17ea-457f-870a-251d3b76a8e6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:05.986196 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c148d78-17ea-457f-870a-251d3b76a8e6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:06.123986 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5c148d78-17ea-457f-870a-251d3b76a8e6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:06.131972 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5c148d78-17ea-457f-870a-251d3b76a8e6 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.167393 Jun 28 12:19:06.132698 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 554/1126] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:05 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:07.151732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3c120dbc-2679-4ac5-9764-07bbbc4cbc1b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:07.152494 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3c120dbc-2679-4ac5-9764-07bbbc4cbc1b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:07.161292 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c120dbc-2679-4ac5-9764-07bbbc4cbc1b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:07.161882 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c120dbc-2679-4ac5-9764-07bbbc4cbc1b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:07.162878 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c120dbc-2679-4ac5-9764-07bbbc4cbc1b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:07.163454 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3c120dbc-2679-4ac5-9764-07bbbc4cbc1b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:07.304626 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3c120dbc-2679-4ac5-9764-07bbbc4cbc1b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:07.312814 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3c120dbc-2679-4ac5-9764-07bbbc4cbc1b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.166435 Jun 28 12:19:07.313415 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 573/1127] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:07 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:08.335183 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d35c0fcb-48e2-4cb5-8402-31295c5a509b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:08.336392 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d35c0fcb-48e2-4cb5-8402-31295c5a509b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:08.347499 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d35c0fcb-48e2-4cb5-8402-31295c5a509b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:08.348255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d35c0fcb-48e2-4cb5-8402-31295c5a509b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:08.349569 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d35c0fcb-48e2-4cb5-8402-31295c5a509b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:08.350299 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d35c0fcb-48e2-4cb5-8402-31295c5a509b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:08.486724 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d35c0fcb-48e2-4cb5-8402-31295c5a509b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:08.495037 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d35c0fcb-48e2-4cb5-8402-31295c5a509b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.166514 Jun 28 12:19:08.495616 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 555/1128] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:08 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:09.516224 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-3ad2f652-9a88-4c6a-be31-b09e887e8352 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:09.517329 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-3ad2f652-9a88-4c6a-be31-b09e887e8352 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:09.526134 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ad2f652-9a88-4c6a-be31-b09e887e8352 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:09.526580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ad2f652-9a88-4c6a-be31-b09e887e8352 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:09.527445 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ad2f652-9a88-4c6a-be31-b09e887e8352 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:09.528013 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-3ad2f652-9a88-4c6a-be31-b09e887e8352 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:09.665833 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-3ad2f652-9a88-4c6a-be31-b09e887e8352 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:09.675497 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-3ad2f652-9a88-4c6a-be31-b09e887e8352 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.166181 Jun 28 12:19:09.676050 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 574/1129] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:09 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:19:10.696455 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-44eb5471-a8d7-4e98-af60-d7678376ef46 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:10.697229 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-44eb5471-a8d7-4e98-af60-d7678376ef46 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:10.706233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44eb5471-a8d7-4e98-af60-d7678376ef46 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:10.706809 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44eb5471-a8d7-4e98-af60-d7678376ef46 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:10.707764 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44eb5471-a8d7-4e98-af60-d7678376ef46 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:10.708311 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44eb5471-a8d7-4e98-af60-d7678376ef46 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:10.850590 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44eb5471-a8d7-4e98-af60-d7678376ef46 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:10.858743 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-44eb5471-a8d7-4e98-af60-d7678376ef46 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.168458 Jun 28 12:19:10.859314 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 556/1130] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:10 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:11.875675 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a5f56749-f533-4664-995d-31ee17b55c32 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:11.876287 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a5f56749-f533-4664-995d-31ee17b55c32 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:11.883502 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5f56749-f533-4664-995d-31ee17b55c32 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:11.883952 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5f56749-f533-4664-995d-31ee17b55c32 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:11.884753 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5f56749-f533-4664-995d-31ee17b55c32 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:11.885221 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a5f56749-f533-4664-995d-31ee17b55c32 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:12.020353 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a5f56749-f533-4664-995d-31ee17b55c32 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:12.029562 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a5f56749-f533-4664-995d-31ee17b55c32 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.157840 Jun 28 12:19:12.030067 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 575/1131] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:11 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:13.051852 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-aa9de30a-e6be-45b1-b5f8-9b72cf16058d tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:13.052816 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-aa9de30a-e6be-45b1-b5f8-9b72cf16058d tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:13.063128 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aa9de30a-e6be-45b1-b5f8-9b72cf16058d tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:13.063888 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aa9de30a-e6be-45b1-b5f8-9b72cf16058d tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:13.065213 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aa9de30a-e6be-45b1-b5f8-9b72cf16058d tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:13.065945 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aa9de30a-e6be-45b1-b5f8-9b72cf16058d tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:13.203636 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-aa9de30a-e6be-45b1-b5f8-9b72cf16058d tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:13.213945 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-aa9de30a-e6be-45b1-b5f8-9b72cf16058d tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.169617 Jun 28 12:19:13.214511 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 557/1132] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:13 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:14.234608 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6d1c2afd-a158-4bf6-95ba-9465fe5ac5a0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:14.235607 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6d1c2afd-a158-4bf6-95ba-9465fe5ac5a0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:14.244783 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6d1c2afd-a158-4bf6-95ba-9465fe5ac5a0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:14.245385 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6d1c2afd-a158-4bf6-95ba-9465fe5ac5a0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:14.246148 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6d1c2afd-a158-4bf6-95ba-9465fe5ac5a0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:14.246586 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6d1c2afd-a158-4bf6-95ba-9465fe5ac5a0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:14.399412 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-6d1c2afd-a158-4bf6-95ba-9465fe5ac5a0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:14.411204 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6d1c2afd-a158-4bf6-95ba-9465fe5ac5a0 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.182809 Jun 28 12:19:14.412022 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 576/1133] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:14 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:14.877945 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-eaa63403-ae3c-45ec-8159-80d361531285 req-1dc36df1-27e0-4735-9c58-163fabddf9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3086f12b-7edc-4ff3-a17d-def512b5679a", "name": "network-vif-plugged", "status": "completed", "tag": "21fbb702-a7b1-4182-9dee-00707b91284d"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:19:14.888203 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-eaa63403-ae3c-45ec-8159-80d361531285 req-1dc36df1-27e0-4735-9c58-163fabddf9ca service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:14.888654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-eaa63403-ae3c-45ec-8159-80d361531285 req-1dc36df1-27e0-4735-9c58-163fabddf9ca service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:14.891717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:14.902966 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-eaa63403-ae3c-45ec-8159-80d361531285 req-1dc36df1-27e0-4735-9c58-163fabddf9ca service nova] Creating event network-vif-plugged:21fbb702-a7b1-4182-9dee-00707b91284d for instance 3086f12b-7edc-4ff3-a17d-def512b5679a on hv-cinder-84795 Jun 28 12:19:14.908735 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-eaa63403-ae3c-45ec-8159-80d361531285 req-1dc36df1-27e0-4735-9c58-163fabddf9ca service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034393 Jun 28 12:19:14.909535 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 558/1134] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:19:15.434405 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8f668f93-aa27-43e3-aaf8-1828ed935686 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:15.435291 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-8f668f93-aa27-43e3-aaf8-1828ed935686 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:15.446307 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f668f93-aa27-43e3-aaf8-1828ed935686 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:15.446751 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f668f93-aa27-43e3-aaf8-1828ed935686 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:15.447511 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f668f93-aa27-43e3-aaf8-1828ed935686 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:15.447937 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-8f668f93-aa27-43e3-aaf8-1828ed935686 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:15.597141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-8f668f93-aa27-43e3-aaf8-1828ed935686 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:15.609887 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8f668f93-aa27-43e3-aaf8-1828ed935686 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.182592 Jun 28 12:19:15.610535 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 577/1135] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:15 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:16.633235 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eccd17ac-af9e-43c9-bf7a-b30f9e2227bd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:16.633908 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eccd17ac-af9e-43c9-bf7a-b30f9e2227bd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:16.635833 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=30 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:16.641431 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eccd17ac-af9e-43c9-bf7a-b30f9e2227bd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:16.641873 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eccd17ac-af9e-43c9-bf7a-b30f9e2227bd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:16.642637 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eccd17ac-af9e-43c9-bf7a-b30f9e2227bd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:16.643064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eccd17ac-af9e-43c9-bf7a-b30f9e2227bd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:16.781446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eccd17ac-af9e-43c9-bf7a-b30f9e2227bd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:16.789209 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eccd17ac-af9e-43c9-bf7a-b30f9e2227bd tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1576 microversion: 2.1 time: 0.164063 Jun 28 12:19:16.789785 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 559/1136] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:16 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:17.808251 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-0aad5402-3ad6-4f62-a5c1-95b73e54c838 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:17.808853 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-0aad5402-3ad6-4f62-a5c1-95b73e54c838 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:17.811214 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=32 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:17.816749 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0aad5402-3ad6-4f62-a5c1-95b73e54c838 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:17.817220 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0aad5402-3ad6-4f62-a5c1-95b73e54c838 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:17.817976 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0aad5402-3ad6-4f62-a5c1-95b73e54c838 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:17.818402 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-0aad5402-3ad6-4f62-a5c1-95b73e54c838 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:17.821391 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:17.954479 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-0aad5402-3ad6-4f62-a5c1-95b73e54c838 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:17.963029 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-0aad5402-3ad6-4f62-a5c1-95b73e54c838 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1563 microversion: 2.1 time: 0.159228 Jun 28 12:19:17.963564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 578/1137] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:17 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:44.927758 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:44.928654 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=7 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:45.019416 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e18a0d5b-ac09-40fc-86ce-355e54493547 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:45.019905 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e18a0d5b-ac09-40fc-86ce-355e54493547 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:45.026160 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e18a0d5b-ac09-40fc-86ce-355e54493547 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:45.026668 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e18a0d5b-ac09-40fc-86ce-355e54493547 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:45.027352 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e18a0d5b-ac09-40fc-86ce-355e54493547 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:45.027779 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e18a0d5b-ac09-40fc-86ce-355e54493547 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:45.051886 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e18a0d5b-ac09-40fc-86ce-355e54493547 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/ips" status: 200 len: 148 microversion: 2.1 time: 0.130213 Jun 28 12:19:45.052435 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 560/1138] 10.222.0.55 () {58 vars in 1247 bytes} [Tue Jun 28 12:19:44 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/ips => generated 148 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:19:46.389948 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5bcf72f7-9134-4f92-914a-3d24a30ecb26 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f86e1e4-85ed-4101-95bd-6db028658a66"}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:19:46.391028 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5bcf72f7-9134-4f92-914a-3d24a30ecb26 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:46.393106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=1 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:46.393758 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=5 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:46.399362 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5bcf72f7-9134-4f92-914a-3d24a30ecb26 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:46.399799 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5bcf72f7-9134-4f92-914a-3d24a30ecb26 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:46.400566 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5bcf72f7-9134-4f92-914a-3d24a30ecb26 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:46.401057 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5bcf72f7-9134-4f92-914a-3d24a30ecb26 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:46.819625 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5bcf72f7-9134-4f92-914a-3d24a30ecb26 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433817 Jun 28 12:19:46.820612 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 579/1139] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:19:46 2022] POST /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:19:54.393816 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-32a5c52b-8210-4dd5-96c0-366d4e10f2e5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f86e1e4-85ed-4101-95bd-6db028658a66"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:19:54.394883 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-32a5c52b-8210-4dd5-96c0-366d4e10f2e5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:54.402064 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32a5c52b-8210-4dd5-96c0-366d4e10f2e5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:54.402522 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32a5c52b-8210-4dd5-96c0-366d4e10f2e5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:54.403296 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32a5c52b-8210-4dd5-96c0-366d4e10f2e5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:54.403734 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32a5c52b-8210-4dd5-96c0-366d4e10f2e5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:54.560515 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-32a5c52b-8210-4dd5-96c0-366d4e10f2e5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Invalid volume: volume 7f86e1e4-85ed-4101-95bd-6db028658a66 is already attached to instances: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-32a5c52b-8210-4dd5-96c0-366d4e10f2e5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: POST /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-volume_attachments HTTP/1.1 Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 74 Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:19:54.562570 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {"volumeAttachment": {"volumeId": "7f86e1e4-85ed-4101-95bd-6db028658a66"}} Jun 28 12:19:54.564367 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Invalid volume: volume 7f86e1e4-85ed-4101-95bd-6db028658a66 is already attached to instances: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'server_id': '6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a', 'body': {'volumeAttachment': {'volumeId': '7f86e1e4-85ed-4101-95bd-6db028658a66'}}} Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7f86e1e4-85ed-4101-95bd-6db028658a66 is already attached to instances: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:19:54.565233 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7f86e1e4-85ed-4101-95bd-6db028658a66 is already attached to instances: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:19:54.566531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:19:54.567853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:19:54.567853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:19:54.567853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:19:54.567853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7f86e1e4-85ed-4101-95bd-6db028658a66 is already attached to instances: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a Jun 28 12:19:54.567853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:19:54.567853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-32a5c52b-8210-4dd5-96c0-366d4e10f2e5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 400 to user: Invalid volume: volume 7f86e1e4-85ed-4101-95bd-6db028658a66 is already attached to instances: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:19:54.567853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-32a5c52b-8210-4dd5-96c0-366d4e10f2e5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.174391 Jun 28 12:19:54.567853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 561/1140] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:19:54 2022] POST /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-volume_attachments => generated 174 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 28 12:19:54.627106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c820c0dc-8e56-46a0-aedb-2311aefa4df7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:54.627661 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c820c0dc-8e56-46a0-aedb-2311aefa4df7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:54.634929 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c820c0dc-8e56-46a0-aedb-2311aefa4df7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:54.635374 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c820c0dc-8e56-46a0-aedb-2311aefa4df7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:54.636132 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c820c0dc-8e56-46a0-aedb-2311aefa4df7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:54.636565 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c820c0dc-8e56-46a0-aedb-2311aefa4df7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:54.729814 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-c820c0dc-8e56-46a0-aedb-2311aefa4df7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lazy-loading 'services' on Instance uuid 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:19:54.810971 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c820c0dc-8e56-46a0-aedb-2311aefa4df7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-volume_attachments/7f86e1e4-85ed-4101-95bd-6db028658a66" status: 202 len: 0 microversion: 2.1 time: 0.187783 Jun 28 12:19:54.811790 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 580/1141] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:19:54 2022] DELETE /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-volume_attachments/7f86e1e4-85ed-4101-95bd-6db028658a66 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:19:54.820345 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-49321d86-b4be-4b3b-a9be-6045245e7c90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:54.821290 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-49321d86-b4be-4b3b-a9be-6045245e7c90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:54.828940 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49321d86-b4be-4b3b-a9be-6045245e7c90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:54.829389 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49321d86-b4be-4b3b-a9be-6045245e7c90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:54.830160 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49321d86-b4be-4b3b-a9be-6045245e7c90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:54.830585 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49321d86-b4be-4b3b-a9be-6045245e7c90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:54.859776 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-49321d86-b4be-4b3b-a9be-6045245e7c90 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 Jun 28 12:19:54.860337 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 562/1142] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:19:54 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:19:55.872957 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-cd4eb51f-25fd-4fbb-91e6-ac0345b28c1c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:55.874049 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-cd4eb51f-25fd-4fbb-91e6-ac0345b28c1c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:55.881169 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cd4eb51f-25fd-4fbb-91e6-ac0345b28c1c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:55.881616 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cd4eb51f-25fd-4fbb-91e6-ac0345b28c1c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:55.882387 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cd4eb51f-25fd-4fbb-91e6-ac0345b28c1c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:55.882822 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-cd4eb51f-25fd-4fbb-91e6-ac0345b28c1c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:55.913643 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-cd4eb51f-25fd-4fbb-91e6-ac0345b28c1c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045594 Jun 28 12:19:55.914182 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 581/1143] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:19:55 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 12:19:55.980115 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4b2bff45-193a-4ad9-a00f-2eb6a6a96013 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:55.980652 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4b2bff45-193a-4ad9-a00f-2eb6a6a96013 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:55.990892 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b2bff45-193a-4ad9-a00f-2eb6a6a96013 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:55.991491 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b2bff45-193a-4ad9-a00f-2eb6a6a96013 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:55.992640 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b2bff45-193a-4ad9-a00f-2eb6a6a96013 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:55.993305 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b2bff45-193a-4ad9-a00f-2eb6a6a96013 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:56.020792 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4b2bff45-193a-4ad9-a00f-2eb6a6a96013 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:19:56.100263 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4b2bff45-193a-4ad9-a00f-2eb6a6a96013 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 204 len: 0 microversion: 2.1 time: 0.125930 Jun 28 12:19:56.100835 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 563/1144] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:19:55 2022] DELETE /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:19:56.109386 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-37f481d0-945a-402a-857d-ade9ad79381a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:56.110129 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-37f481d0-945a-402a-857d-ade9ad79381a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:56.116310 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37f481d0-945a-402a-857d-ade9ad79381a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:56.116753 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37f481d0-945a-402a-857d-ade9ad79381a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:56.117538 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37f481d0-945a-402a-857d-ade9ad79381a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:56.117970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-37f481d0-945a-402a-857d-ade9ad79381a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:56.260866 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-37f481d0-945a-402a-857d-ade9ad79381a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:56.269136 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-37f481d0-945a-402a-857d-ade9ad79381a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1680 microversion: 2.1 time: 0.163591 Jun 28 12:19:56.269707 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 582/1145] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:56 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:19:57.291694 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-794c9ed8-4a31-4c67-af12-5e6884ae3933 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:57.292853 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-794c9ed8-4a31-4c67-af12-5e6884ae3933 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:57.304045 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-794c9ed8-4a31-4c67-af12-5e6884ae3933 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:57.304793 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-794c9ed8-4a31-4c67-af12-5e6884ae3933 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:57.306164 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-794c9ed8-4a31-4c67-af12-5e6884ae3933 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:57.306932 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-794c9ed8-4a31-4c67-af12-5e6884ae3933 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:57.467585 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-794c9ed8-4a31-4c67-af12-5e6884ae3933 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:57.475928 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-794c9ed8-4a31-4c67-af12-5e6884ae3933 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1680 microversion: 2.1 time: 0.191334 Jun 28 12:19:57.476537 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 564/1146] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:57 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:58.497302 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-175df323-d94d-43ff-a33b-a12657b44615 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:58.497902 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-175df323-d94d-43ff-a33b-a12657b44615 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:58.505304 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-175df323-d94d-43ff-a33b-a12657b44615 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:58.505750 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-175df323-d94d-43ff-a33b-a12657b44615 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:58.506518 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-175df323-d94d-43ff-a33b-a12657b44615 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:58.506942 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-175df323-d94d-43ff-a33b-a12657b44615 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:58.641167 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-175df323-d94d-43ff-a33b-a12657b44615 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:58.649096 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-175df323-d94d-43ff-a33b-a12657b44615 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1680 microversion: 2.1 time: 0.155789 Jun 28 12:19:58.649701 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 583/1147] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:58 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:19:59.138504 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-5bef830d-def5-4be0-8ad7-b07402126596 req-2f03808d-09f0-43c2-91e1-72f94b4b2a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a", "name": "network-vif-deleted", "tag": "cb2dac50-f6e7-4477-a200-a94a8fe061d3"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:19:59.148061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5bef830d-def5-4be0-8ad7-b07402126596 req-2f03808d-09f0-43c2-91e1-72f94b4b2a85 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:59.148503 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5bef830d-def5-4be0-8ad7-b07402126596 req-2f03808d-09f0-43c2-91e1-72f94b4b2a85 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:59.159723 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-5bef830d-def5-4be0-8ad7-b07402126596 req-2f03808d-09f0-43c2-91e1-72f94b4b2a85 service nova] Creating event network-vif-deleted:cb2dac50-f6e7-4477-a200-a94a8fe061d3 for instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a on hv-cinder-84795 Jun 28 12:19:59.168999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-5bef830d-def5-4be0-8ad7-b07402126596 req-2f03808d-09f0-43c2-91e1-72f94b4b2a85 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033930 Jun 28 12:19:59.169793 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 565/1148] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:19:59.667286 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ab1206ba-92b7-4b91-809b-9b12afc35c11 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:19:59.667980 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ab1206ba-92b7-4b91-809b-9b12afc35c11 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:19:59.675465 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab1206ba-92b7-4b91-809b-9b12afc35c11 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:59.676260 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab1206ba-92b7-4b91-809b-9b12afc35c11 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:59.678061 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab1206ba-92b7-4b91-809b-9b12afc35c11 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:59.678775 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab1206ba-92b7-4b91-809b-9b12afc35c11 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:59.725558 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab1206ba-92b7-4b91-809b-9b12afc35c11 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:19:59.726165 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ab1206ba-92b7-4b91-809b-9b12afc35c11 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:19:59.726696 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-ab1206ba-92b7-4b91-809b-9b12afc35c11 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lazy-loading 'fault' on Instance uuid 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:19:59.773331 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-ab1206ba-92b7-4b91-809b-9b12afc35c11 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:19:59.780472 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ab1206ba-92b7-4b91-809b-9b12afc35c11 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 200 len: 1331 microversion: 2.1 time: 0.117747 Jun 28 12:19:59.781560 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 584/1149] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:19:59 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:00.801855 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-af5b3ca9-c6c7-44ad-ba94-4b92ad507ad5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:00.802562 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-af5b3ca9-c6c7-44ad-ba94-4b92ad507ad5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:00.809424 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af5b3ca9-c6c7-44ad-ba94-4b92ad507ad5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:00.809869 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af5b3ca9-c6c7-44ad-ba94-4b92ad507ad5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:00.810625 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af5b3ca9-c6c7-44ad-ba94-4b92ad507ad5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:00.811057 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-af5b3ca9-c6c7-44ad-ba94-4b92ad507ad5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:00.825387 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-af5b3ca9-c6c7-44ad-ba94-4b92ad507ad5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-af5b3ca9-c6c7-44ad-ba94-4b92ad507ad5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a HTTP/1.1 Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:20:00.826982 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:20:00.828520 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a'} Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:20:00.829375 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:20:00.830750 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:20:00.832127 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-af5b3ca9-c6c7-44ad-ba94-4b92ad507ad5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:20:00.832127 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-af5b3ca9-c6c7-44ad-ba94-4b92ad507ad5 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 404 len: 111 microversion: 2.1 time: 0.031752 Jun 28 12:20:00.832127 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 566/1150] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:00 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:20:00.840983 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-8cbf8599-9e9f-48cd-8452-420793007079 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '.version_select at 0x7f3932da3430>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:00.866326 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-8cbf8599-9e9f-48cd-8452-420793007079 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-100122563" status: 202 len: 0 microversion: 2.1 time: 0.031685 Jun 28 12:20:00.866861 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 585/1151] 10.222.0.55 () {58 vars in 1217 bytes} [Tue Jun 28 12:20:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-100122563 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:20:01.508965 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-500cb04c-608d-4957-b77a-03b4fea028ed tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: .version_select at 0x7f3932e664c0>, body: {"keypair": {"name": "tempest-keypair-579884352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMrWURiTPuTp6r+KgjysQQGS4CxeKa+LTPJzHIrtmFZ7WVxSpfZuiZzuXtzHHnkuxjJFoDtk+pnk/DJ6U8Q02KUjMzHJP6a0JqW4Y45zChNLZrfWmwN4f9n6kOIGxMjBA=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:20:01.523720 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-500cb04c-608d-4957-b77a-03b4fea028ed tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:20:01.527765 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-500cb04c-608d-4957-b77a-03b4fea028ed tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for user f2f9826f53b44e1bbaf721d66de1356b and project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:20:01.551403 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-500cb04c-608d-4957-b77a-03b4fea028ed tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046364 Jun 28 12:20:01.551973 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 567/1152] 10.222.0.55 () {60 vars in 1158 bytes} [Tue Jun 28 12:20:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:20:02.830735 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-34627932", "imageRef": "851db68a-6e19-4a43-9a91-21f7eeee9fc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ab7246a-96e7-4fc8-aac1-d967c789fbd7"}], "security_groups": [{"name": "tempest-securitygroup--51142960"}], "key_name": "tempest-keypair-579884352", "user_data": "}} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:20:02.942845 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.network.neutron [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] validate_networks() for [('7ab7246a-96e7-4fc8-aac1-d967c789fbd7', None, None, None, None, None)] {{(pid=117888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 12:20:03.332248 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Flavor limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 12:20:03.332846 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Image limits 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 12:20:03.333624 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Flavor pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 12:20:03.334175 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Image pref 0:0:0 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 12:20:03.334827 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.virt.hardware [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 12:20:03.347277 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:03.347717 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:03.348510 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:03.348932 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:03.366162 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 12:20:03.370586 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.quota [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Getting quotas for user f2f9826f53b44e1bbaf721d66de1356b and project 6cf87482b69e40dda5b8104e3e1b12e8. Resources: {'cores', 'ram', 'instances'} {{(pid=117888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 12:20:03.383037 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Going to run 1 instances... {{(pid=117888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 12:20:03.385372 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='851db68a-6e19-4a43-9a91-21f7eeee9fc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 12:20:03.442845 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-5f52a60e-76ad-4341-9279-4e417eb4c5d2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.617316 Jun 28 12:20:03.443540 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 586/1153] 10.222.0.55 () {60 vars in 1146 bytes} [Tue Jun 28 12:20:02 2022] POST /compute/v2.1/servers => generated 400 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 12:20:03.455263 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-01c1a928-3816-455f-b6dc-b53778362e8a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:03.455841 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-01c1a928-3816-455f-b6dc-b53778362e8a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:03.514250 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-01c1a928-3816-455f-b6dc-b53778362e8a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:03.520934 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-01c1a928-3816-455f-b6dc-b53778362e8a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1239 microversion: 2.1 time: 0.070701 Jun 28 12:20:03.521530 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 568/1154] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:03 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:04.538560 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-4095ae7e-9029-4758-8d7d-fd00fe67a31a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:04.539910 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-4095ae7e-9029-4758-8d7d-fd00fe67a31a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:04.546603 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4095ae7e-9029-4758-8d7d-fd00fe67a31a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:04.547048 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4095ae7e-9029-4758-8d7d-fd00fe67a31a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:04.548084 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4095ae7e-9029-4758-8d7d-fd00fe67a31a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:04.548524 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-4095ae7e-9029-4758-8d7d-fd00fe67a31a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:04.620178 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-4095ae7e-9029-4758-8d7d-fd00fe67a31a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:04.628711 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-4095ae7e-9029-4758-8d7d-fd00fe67a31a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1309 microversion: 2.1 time: 0.094480 Jun 28 12:20:04.629742 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 587/1155] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:04 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:05.645984 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-627dab9e-ba91-4af9-9981-d943a4881f92 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:05.646789 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-627dab9e-ba91-4af9-9981-d943a4881f92 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:05.654145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-627dab9e-ba91-4af9-9981-d943a4881f92 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:05.654816 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-627dab9e-ba91-4af9-9981-d943a4881f92 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:05.656069 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-627dab9e-ba91-4af9-9981-d943a4881f92 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:05.656509 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-627dab9e-ba91-4af9-9981-d943a4881f92 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:05.894876 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-627dab9e-ba91-4af9-9981-d943a4881f92 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:05.903289 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-627dab9e-ba91-4af9-9981-d943a4881f92 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1363 microversion: 2.1 time: 0.261166 Jun 28 12:20:05.903900 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 569/1156] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:05 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:06.033317 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-6ca53840-d8a4-4aa1-8b7b-5ea937dfe175 req-b55175e1-2e10-4c56-958c-375382a86dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1515685b-eac4-46f1-a404-44701babc900", "tag": "f56109ec-ba13-43bb-b6ad-537c1b281116"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:20:06.044735 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-6ca53840-d8a4-4aa1-8b7b-5ea937dfe175 req-b55175e1-2e10-4c56-958c-375382a86dee service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:06.049355 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-6ca53840-d8a4-4aa1-8b7b-5ea937dfe175 req-b55175e1-2e10-4c56-958c-375382a86dee service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:06.063799 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-6ca53840-d8a4-4aa1-8b7b-5ea937dfe175 req-b55175e1-2e10-4c56-958c-375382a86dee service nova] Creating event network-changed:f56109ec-ba13-43bb-b6ad-537c1b281116 for instance 1515685b-eac4-46f1-a404-44701babc900 on hv-cinder-84795 Jun 28 12:20:06.069018 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-6ca53840-d8a4-4aa1-8b7b-5ea937dfe175 req-b55175e1-2e10-4c56-958c-375382a86dee service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040121 Jun 28 12:20:06.069628 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 588/1157] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:20:06.925020 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bea7d630-bb20-48bd-bf2d-b5545465b191 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:06.926159 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bea7d630-bb20-48bd-bf2d-b5545465b191 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:06.937596 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bea7d630-bb20-48bd-bf2d-b5545465b191 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:06.938397 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bea7d630-bb20-48bd-bf2d-b5545465b191 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:06.939707 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bea7d630-bb20-48bd-bf2d-b5545465b191 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:06.940576 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bea7d630-bb20-48bd-bf2d-b5545465b191 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:07.082983 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bea7d630-bb20-48bd-bf2d-b5545465b191 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:07.090655 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bea7d630-bb20-48bd-bf2d-b5545465b191 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1363 microversion: 2.1 time: 0.172169 Jun 28 12:20:07.091220 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 570/1158] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:06 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:08.113388 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e80aeede-d12f-498e-98c1-98b72d38c964 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:08.113989 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e80aeede-d12f-498e-98c1-98b72d38c964 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:08.120867 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80aeede-d12f-498e-98c1-98b72d38c964 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:08.121350 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80aeede-d12f-498e-98c1-98b72d38c964 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:08.122125 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80aeede-d12f-498e-98c1-98b72d38c964 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:08.122559 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e80aeede-d12f-498e-98c1-98b72d38c964 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:08.261195 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-e80aeede-d12f-498e-98c1-98b72d38c964 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:08.269590 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e80aeede-d12f-498e-98c1-98b72d38c964 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1363 microversion: 2.1 time: 0.163933 Jun 28 12:20:08.270153 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 589/1159] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:08 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:09.286946 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1acc2901-e699-44c9-bae2-f8dc550c081a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:09.287695 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1acc2901-e699-44c9-bae2-f8dc550c081a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:09.294791 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1acc2901-e699-44c9-bae2-f8dc550c081a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:09.295255 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1acc2901-e699-44c9-bae2-f8dc550c081a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:09.296020 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1acc2901-e699-44c9-bae2-f8dc550c081a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:09.296457 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1acc2901-e699-44c9-bae2-f8dc550c081a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:09.429120 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1acc2901-e699-44c9-bae2-f8dc550c081a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:09.436637 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1acc2901-e699-44c9-bae2-f8dc550c081a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1363 microversion: 2.1 time: 0.153956 Jun 28 12:20:09.437308 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 571/1160] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:09 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:10.457573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a2758535-914e-46a4-8b50-3a23a8c2da20 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:10.458184 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a2758535-914e-46a4-8b50-3a23a8c2da20 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:10.465214 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2758535-914e-46a4-8b50-3a23a8c2da20 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:10.465670 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2758535-914e-46a4-8b50-3a23a8c2da20 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:10.466436 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2758535-914e-46a4-8b50-3a23a8c2da20 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:10.466867 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a2758535-914e-46a4-8b50-3a23a8c2da20 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:10.607109 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-a2758535-914e-46a4-8b50-3a23a8c2da20 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:10.615613 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a2758535-914e-46a4-8b50-3a23a8c2da20 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1363 microversion: 2.1 time: 0.164224 Jun 28 12:20:10.616182 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 590/1161] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:10 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:11.182672 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-d7c1f4f2-5beb-4ca1-8585-654a326c4068 req-8be0f683-862d-4782-8d6c-de6c50b2785d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1515685b-eac4-46f1-a404-44701babc900", "name": "network-vif-plugged", "status": "completed", "tag": "f56109ec-ba13-43bb-b6ad-537c1b281116"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:20:11.191739 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d7c1f4f2-5beb-4ca1-8585-654a326c4068 req-8be0f683-862d-4782-8d6c-de6c50b2785d service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:11.192207 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d7c1f4f2-5beb-4ca1-8585-654a326c4068 req-8be0f683-862d-4782-8d6c-de6c50b2785d service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:11.203720 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-d7c1f4f2-5beb-4ca1-8585-654a326c4068 req-8be0f683-862d-4782-8d6c-de6c50b2785d service nova] Creating event network-vif-plugged:f56109ec-ba13-43bb-b6ad-537c1b281116 for instance 1515685b-eac4-46f1-a404-44701babc900 on hv-cinder-84795 Jun 28 12:20:11.209534 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-d7c1f4f2-5beb-4ca1-8585-654a326c4068 req-8be0f683-862d-4782-8d6c-de6c50b2785d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030570 Jun 28 12:20:11.210122 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 572/1162] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:20:11.633441 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2b48acdb-7b49-44a5-9aa8-e537e9c387e8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:11.634036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2b48acdb-7b49-44a5-9aa8-e537e9c387e8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:11.641106 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b48acdb-7b49-44a5-9aa8-e537e9c387e8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:11.641558 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b48acdb-7b49-44a5-9aa8-e537e9c387e8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:11.642319 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b48acdb-7b49-44a5-9aa8-e537e9c387e8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:11.642755 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2b48acdb-7b49-44a5-9aa8-e537e9c387e8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:11.782523 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-2b48acdb-7b49-44a5-9aa8-e537e9c387e8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:11.790741 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2b48acdb-7b49-44a5-9aa8-e537e9c387e8 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1363 microversion: 2.1 time: 0.161479 Jun 28 12:20:11.791305 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 591/1163] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:11 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:12.809890 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cf78c733-8c56-4e6d-aee8-3a174a6966f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:12.810584 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cf78c733-8c56-4e6d-aee8-3a174a6966f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:12.817634 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf78c733-8c56-4e6d-aee8-3a174a6966f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:12.818076 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf78c733-8c56-4e6d-aee8-3a174a6966f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:12.818837 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf78c733-8c56-4e6d-aee8-3a174a6966f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:12.819266 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cf78c733-8c56-4e6d-aee8-3a174a6966f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:12.958022 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cf78c733-8c56-4e6d-aee8-3a174a6966f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:12.969543 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cf78c733-8c56-4e6d-aee8-3a174a6966f2 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1363 microversion: 2.1 time: 0.164159 Jun 28 12:20:12.970332 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 573/1164] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:12 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:13.990753 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-767b420f-2175-46b9-b12e-b65207948713 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:13.991379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-767b420f-2175-46b9-b12e-b65207948713 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:13.993879 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:13.994623 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell0:SELECT=6 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:14.000764 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-767b420f-2175-46b9-b12e-b65207948713 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:14.001240 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-767b420f-2175-46b9-b12e-b65207948713 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:14.002004 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-767b420f-2175-46b9-b12e-b65207948713 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:14.002439 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-767b420f-2175-46b9-b12e-b65207948713 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:14.150919 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-767b420f-2175-46b9-b12e-b65207948713 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:14.158653 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-767b420f-2175-46b9-b12e-b65207948713 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1553 microversion: 2.1 time: 0.173450 Jun 28 12:20:14.159220 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 592/1165] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:13 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:14.175114 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1b04b79b-3377-4f54-990a-695d14baf78e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:14.175645 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1b04b79b-3377-4f54-990a-695d14baf78e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:14.177799 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:14.184061 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b04b79b-3377-4f54-990a-695d14baf78e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:14.184515 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b04b79b-3377-4f54-990a-695d14baf78e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:14.185311 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b04b79b-3377-4f54-990a-695d14baf78e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:14.185748 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b04b79b-3377-4f54-990a-695d14baf78e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:14.271418 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1b04b79b-3377-4f54-990a-695d14baf78e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100244 Jun 28 12:20:14.272048 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 574/1166] 10.222.0.55 () {58 vars in 1274 bytes} [Tue Jun 28 12:20:14 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 12:20:15.517094 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-b85381d8-5593-4600-88ba-ba3ab9abbafc req-90b5e94d-980c-403a-8ca6-b7d7c6007eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1515685b-eac4-46f1-a404-44701babc900", "tag": "f56109ec-ba13-43bb-b6ad-537c1b281116"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:20:15.526145 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-b85381d8-5593-4600-88ba-ba3ab9abbafc req-90b5e94d-980c-403a-8ca6-b7d7c6007eea service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:15.526652 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-b85381d8-5593-4600-88ba-ba3ab9abbafc req-90b5e94d-980c-403a-8ca6-b7d7c6007eea service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:15.537824 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-b85381d8-5593-4600-88ba-ba3ab9abbafc req-90b5e94d-980c-403a-8ca6-b7d7c6007eea service nova] Creating event network-changed:f56109ec-ba13-43bb-b6ad-537c1b281116 for instance 1515685b-eac4-46f1-a404-44701babc900 on hv-cinder-84795 Jun 28 12:20:15.543302 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-b85381d8-5593-4600-88ba-ba3ab9abbafc req-90b5e94d-980c-403a-8ca6-b7d7c6007eea service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029970 Jun 28 12:20:15.544266 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 593/1167] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:20:46.120118 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:46.123467 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:46.125057 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:46.125861 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:46.132591 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-658b2934-d1e0-41ae-8e9d-226d1121c6c5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:46.133132 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-658b2934-d1e0-41ae-8e9d-226d1121c6c5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:46.145477 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-658b2934-d1e0-41ae-8e9d-226d1121c6c5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:46.145939 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-658b2934-d1e0-41ae-8e9d-226d1121c6c5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:46.148353 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-658b2934-d1e0-41ae-8e9d-226d1121c6c5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:46.149495 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-658b2934-d1e0-41ae-8e9d-226d1121c6c5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:46.177428 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-658b2934-d1e0-41ae-8e9d-226d1121c6c5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:20:46.208750 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-d737f56f-c931-412e-b972-f027ed8456d9 req-29f7ba34-aad0-463c-83c1-db792a33941d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3086f12b-7edc-4ff3-a17d-def512b5679a", "tag": "21fbb702-a7b1-4182-9dee-00707b91284d"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:20:46.217633 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-d737f56f-c931-412e-b972-f027ed8456d9 req-29f7ba34-aad0-463c-83c1-db792a33941d service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:46.218102 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-d737f56f-c931-412e-b972-f027ed8456d9 req-29f7ba34-aad0-463c-83c1-db792a33941d service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:46.233515 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-d737f56f-c931-412e-b972-f027ed8456d9 req-29f7ba34-aad0-463c-83c1-db792a33941d service nova] Creating event network-changed:21fbb702-a7b1-4182-9dee-00707b91284d for instance 3086f12b-7edc-4ff3-a17d-def512b5679a on hv-cinder-84795 Jun 28 12:20:46.239625 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-d737f56f-c931-412e-b972-f027ed8456d9 req-29f7ba34-aad0-463c-83c1-db792a33941d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117580 Jun 28 12:20:46.241002 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 594/1168] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:20:46.260604 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-658b2934-d1e0-41ae-8e9d-226d1121c6c5 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 204 len: 0 microversion: 2.1 time: 0.141747 Jun 28 12:20:46.261286 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 575/1169] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:20:46 2022] DELETE /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 12:20:46.270290 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-78dd82c0-9283-44b4-b8e2-61a5551350ab tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:46.270988 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-78dd82c0-9283-44b4-b8e2-61a5551350ab tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:46.277858 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-78dd82c0-9283-44b4-b8e2-61a5551350ab tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:46.278516 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-78dd82c0-9283-44b4-b8e2-61a5551350ab tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:46.279277 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-78dd82c0-9283-44b4-b8e2-61a5551350ab tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:46.279711 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-78dd82c0-9283-44b4-b8e2-61a5551350ab tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:46.424093 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-78dd82c0-9283-44b4-b8e2-61a5551350ab tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:46.431755 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-78dd82c0-9283-44b4-b8e2-61a5551350ab tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.165846 Jun 28 12:20:46.432331 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 595/1170] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:46 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 12:20:47.451859 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6499b1fd-011d-4b3e-a632-24c5502c781b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:47.452438 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6499b1fd-011d-4b3e-a632-24c5502c781b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:47.459388 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6499b1fd-011d-4b3e-a632-24c5502c781b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:47.459835 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6499b1fd-011d-4b3e-a632-24c5502c781b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:47.460593 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6499b1fd-011d-4b3e-a632-24c5502c781b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:47.461072 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6499b1fd-011d-4b3e-a632-24c5502c781b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:47.663476 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6499b1fd-011d-4b3e-a632-24c5502c781b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:47.675989 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6499b1fd-011d-4b3e-a632-24c5502c781b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1569 microversion: 2.1 time: 0.229252 Jun 28 12:20:47.676857 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 576/1171] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:47 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:48.638117 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [req-360341f9-576c-43fc-be2f-419ec8098986 req-1eb0a6ca-0c14-4250-a693-cdbcdd67d1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3086f12b-7edc-4ff3-a17d-def512b5679a", "name": "network-vif-deleted", "tag": "21fbb702-a7b1-4182-9dee-00707b91284d"}]} {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:20:48.646740 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-360341f9-576c-43fc-be2f-419ec8098986 req-1eb0a6ca-0c14-4250-a693-cdbcdd67d1ba service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:48.647176 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [req-360341f9-576c-43fc-be2f-419ec8098986 req-1eb0a6ca-0c14-4250-a693-cdbcdd67d1ba service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:48.659062 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.compute.server_external_events [req-360341f9-576c-43fc-be2f-419ec8098986 req-1eb0a6ca-0c14-4250-a693-cdbcdd67d1ba service nova] Creating event network-vif-deleted:21fbb702-a7b1-4182-9dee-00707b91284d for instance 3086f12b-7edc-4ff3-a17d-def512b5679a on hv-cinder-84795 Jun 28 12:20:48.664042 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [req-360341f9-576c-43fc-be2f-419ec8098986 req-1eb0a6ca-0c14-4250-a693-cdbcdd67d1ba service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030131 Jun 28 12:20:48.664672 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 596/1172] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:20:48.695758 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a76a7c0b-fb4f-4503-819c-d2fd137ce33c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:48.696480 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a76a7c0b-fb4f-4503-819c-d2fd137ce33c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:48.707717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a76a7c0b-fb4f-4503-819c-d2fd137ce33c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:48.707717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a76a7c0b-fb4f-4503-819c-d2fd137ce33c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:48.707717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a76a7c0b-fb4f-4503-819c-d2fd137ce33c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:48.707717 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a76a7c0b-fb4f-4503-819c-d2fd137ce33c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:48.772053 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a76a7c0b-fb4f-4503-819c-d2fd137ce33c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0c3b5771de4561835b6bb4a74c86ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6e9f5c280479d9050a6bfdde0d68b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:20:48.779913 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a76a7c0b-fb4f-4503-819c-d2fd137ce33c tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 200 len: 1219 microversion: 2.1 time: 0.088166 Jun 28 12:20:48.780477 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 577/1173] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:48 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:20:49.799620 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ef532836-b7ee-414c-b0ea-360614656e22 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:49.800970 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-ef532836-b7ee-414c-b0ea-360614656e22 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] [instance: 3086f12b-7edc-4ff3-a17d-def512b5679a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:20:49.810083 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef532836-b7ee-414c-b0ea-360614656e22 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:49.810762 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef532836-b7ee-414c-b0ea-360614656e22 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:49.811489 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef532836-b7ee-414c-b0ea-360614656e22 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:20:49.811927 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-ef532836-b7ee-414c-b0ea-360614656e22 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:20:49.826015 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-ef532836-b7ee-414c-b0ea-360614656e22 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] HTTP exception thrown: Instance 3086f12b-7edc-4ff3-a17d-def512b5679a could not be found. Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ef532836-b7ee-414c-b0ea-360614656e22 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Request method failure captured: Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a HTTP/1.1 Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuvDipSyQlfyDc4jsGTGPf0o09Kwl1GP_f7pj-XnRlhfWO_Dc8zBOrMcS_uE7PUQBObrM5ldjChCN8t_9c-iAY_zZbHJoXOIPBcwHIjy6MKej4WSK0hmXnOQzTaO37V5GXzIDM3uc6QCmL0qcJfuRzhCgPC6E3upxmqN38YqLrRntjmo Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 56f6e9f5c280479d9050a6bfdde0d68b Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-TestShelveInstance-929480018 Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:20:49.827520 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/56f6e9f5c280479d9050a6bfdde0d68b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/56f6e9f5c280479d9050a6bfdde0d68b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_56f6e9f5c280479d9050a6bfdde0d68b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/56f6e9f5c280479d9050a6bfdde0d68b"}]}] Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-TestShelveInstance-929480018 Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 56f6e9f5c280479d9050a6bfdde0d68b Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-TestShelveInstance-929480018 Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-TestShelveInstance-929480018-project Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: 1c0c3b5771de4561835b6bb4a74c86ed Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-TestShelveInstance-929480018-project Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance 3086f12b-7edc-4ff3-a17d-def512b5679a could not be found. Jun 28 12:20:49.829360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '3086f12b-7edc-4ff3-a17d-def512b5679a'} Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3086f12b-7edc-4ff3-a17d-def512b5679a could not be found. Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:20:49.830549 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3086f12b-7edc-4ff3-a17d-def512b5679a could not be found. Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3086f12b-7edc-4ff3-a17d-def512b5679a could not be found. Jun 28 12:20:49.831936 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:20:49.833336 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-ef532836-b7ee-414c-b0ea-360614656e22 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Returning 404 to user: Instance 3086f12b-7edc-4ff3-a17d-def512b5679a could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:20:49.833336 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-ef532836-b7ee-414c-b0ea-360614656e22 tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a" status: 404 len: 111 microversion: 2.1 time: 0.035580 Jun 28 12:20:49.833336 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 597/1174] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:20:49 2022] GET /compute/v2.1/servers/3086f12b-7edc-4ff3-a17d-def512b5679a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:20:49.998620 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-15447584-efcf-46b8-8c12-500339d5306b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] Calling method '.version_select at 0x7f3932e35310>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:20:50.018955 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-15447584-efcf-46b8-8c12-500339d5306b tempest-TestShelveInstance-929480018 tempest-TestShelveInstance-929480018-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-493460915" status: 202 len: 0 microversion: 2.1 time: 0.024389 Jun 28 12:20:50.019723 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 578/1175] 10.222.0.55 () {58 vars in 1250 bytes} [Tue Jun 28 12:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-493460915 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:21:20.156865 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-6e59a899-5977-4e8f-834d-46bfced2476d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:20.157858 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-6e59a899-5977-4e8f-834d-46bfced2476d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:20.160966 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_api:SELECT=8 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:21:20.162010 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG dbcounter [-] [117888] Writing DB stats nova_cell1:SELECT=12 {{(pid=117888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:21:20.172245 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e59a899-5977-4e8f-834d-46bfced2476d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:20.172963 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e59a899-5977-4e8f-834d-46bfced2476d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:20.174340 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e59a899-5977-4e8f-834d-46bfced2476d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:20.174995 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-6e59a899-5977-4e8f-834d-46bfced2476d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:20.201547 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-6e59a899-5977-4e8f-834d-46bfced2476d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/ips" status: 200 len: 149 microversion: 2.1 time: 0.049303 Jun 28 12:21:20.202105 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 598/1176] 10.222.0.55 () {58 vars in 1247 bytes} [Tue Jun 28 12:21:20 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:21:21.530668 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:21:21.531426 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:21:21.536051 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4d4e3c9d-4f54-41c9-8eec-c62b551303ca tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31564231-4364-4cec-b845-71abc85a30cc"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:21:21.537151 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4d4e3c9d-4f54-41c9-8eec-c62b551303ca tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:21.546802 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d4e3c9d-4f54-41c9-8eec-c62b551303ca tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:21.547262 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d4e3c9d-4f54-41c9-8eec-c62b551303ca tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:21.548012 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d4e3c9d-4f54-41c9-8eec-c62b551303ca tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:21.548451 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d4e3c9d-4f54-41c9-8eec-c62b551303ca tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:21.818825 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4d4e3c9d-4f54-41c9-8eec-c62b551303ca tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "POST /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289455 Jun 28 12:21:21.819438 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 579/1177] 10.222.0.55 () {60 vars in 1322 bytes} [Tue Jun 28 12:21:21 2022] POST /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:21:22.069559 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:21:22.069806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Tue Jun 28 12:21:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:21:29.463698 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e1ffaf2e-0b43-447d-af90-4875ff82927f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:29.464711 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e1ffaf2e-0b43-447d-af90-4875ff82927f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:29.470888 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e1ffaf2e-0b43-447d-af90-4875ff82927f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:29.471328 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e1ffaf2e-0b43-447d-af90-4875ff82927f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:29.472080 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e1ffaf2e-0b43-447d-af90-4875ff82927f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:29.472508 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e1ffaf2e-0b43-447d-af90-4875ff82927f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:29.556421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.objects.instance [None req-e1ffaf2e-0b43-447d-af90-4875ff82927f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lazy-loading 'services' on Instance uuid 1515685b-eac4-46f1-a404-44701babc900 {{(pid=117888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 12:21:29.637046 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e1ffaf2e-0b43-447d-af90-4875ff82927f tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/os-volume_attachments/31564231-4364-4cec-b845-71abc85a30cc" status: 202 len: 0 microversion: 2.1 time: 0.177169 Jun 28 12:21:29.637636 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 599/1178] 10.222.0.55 () {58 vars in 1415 bytes} [Tue Jun 28 12:21:29 2022] DELETE /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/os-volume_attachments/31564231-4364-4cec-b845-71abc85a30cc => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:21:29.647156 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d76e8ba8-7ba3-4637-b797-b0532dd9acd0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:29.648318 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d76e8ba8-7ba3-4637-b797-b0532dd9acd0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:29.658132 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d76e8ba8-7ba3-4637-b797-b0532dd9acd0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:29.658887 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d76e8ba8-7ba3-4637-b797-b0532dd9acd0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:29.660706 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d76e8ba8-7ba3-4637-b797-b0532dd9acd0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:29.661667 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d76e8ba8-7ba3-4637-b797-b0532dd9acd0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:29.695834 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d76e8ba8-7ba3-4637-b797-b0532dd9acd0 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053491 Jun 28 12:21:29.696379 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 580/1179] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:21:29 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:21:30.714938 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-c19e4b6c-ae43-4e8c-aff4-ec9a5486f7eb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:30.716434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-c19e4b6c-ae43-4e8c-aff4-ec9a5486f7eb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:30.727173 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c19e4b6c-ae43-4e8c-aff4-ec9a5486f7eb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:30.727926 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c19e4b6c-ae43-4e8c-aff4-ec9a5486f7eb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:30.729264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c19e4b6c-ae43-4e8c-aff4-ec9a5486f7eb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:30.729843 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-c19e4b6c-ae43-4e8c-aff4-ec9a5486f7eb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:30.758887 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-c19e4b6c-ae43-4e8c-aff4-ec9a5486f7eb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052375 Jun 28 12:21:30.759436 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 600/1180] 10.222.0.55 () {58 vars in 1301 bytes} [Tue Jun 28 12:21:30 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 12:21:30.823656 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a966574d-a34f-4af9-9a5b-003c4918c71a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:30.824181 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a966574d-a34f-4af9-9a5b-003c4918c71a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:30.831537 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a966574d-a34f-4af9-9a5b-003c4918c71a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:30.831999 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a966574d-a34f-4af9-9a5b-003c4918c71a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:30.832770 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a966574d-a34f-4af9-9a5b-003c4918c71a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:30.833245 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a966574d-a34f-4af9-9a5b-003c4918c71a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:30.858563 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a966574d-a34f-4af9-9a5b-003c4918c71a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 12:21:30.941802 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a966574d-a34f-4af9-9a5b-003c4918c71a tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 204 len: 0 microversion: 2.1 time: 0.122160 Jun 28 12:21:30.942498 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 581/1181] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:21:30 2022] DELETE /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 12:21:30.952240 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7c4da5a5-e7b1-40ce-be6b-9529cf9ce6e1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:30.952857 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7c4da5a5-e7b1-40ce-be6b-9529cf9ce6e1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:30.958939 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c4da5a5-e7b1-40ce-be6b-9529cf9ce6e1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:30.959384 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c4da5a5-e7b1-40ce-be6b-9529cf9ce6e1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:30.960127 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c4da5a5-e7b1-40ce-be6b-9529cf9ce6e1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:30.960552 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7c4da5a5-e7b1-40ce-be6b-9529cf9ce6e1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:31.099802 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7c4da5a5-e7b1-40ce-be6b-9529cf9ce6e1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:21:31.109643 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7c4da5a5-e7b1-40ce-be6b-9529cf9ce6e1 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1677 microversion: 2.1 time: 0.162307 Jun 28 12:21:31.110216 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 601/1182] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:21:30 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:21:32.129297 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ca398cdf-ecc5-4fa5-9e3e-a04ee9d7f92d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:32.129877 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ca398cdf-ecc5-4fa5-9e3e-a04ee9d7f92d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:32.137993 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca398cdf-ecc5-4fa5-9e3e-a04ee9d7f92d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:32.138529 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca398cdf-ecc5-4fa5-9e3e-a04ee9d7f92d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:32.139429 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca398cdf-ecc5-4fa5-9e3e-a04ee9d7f92d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:32.139943 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca398cdf-ecc5-4fa5-9e3e-a04ee9d7f92d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:32.285309 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ca398cdf-ecc5-4fa5-9e3e-a04ee9d7f92d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:21:32.293618 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ca398cdf-ecc5-4fa5-9e3e-a04ee9d7f92d tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1677 microversion: 2.1 time: 0.169703 Jun 28 12:21:32.294187 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 582/1183] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:21:32 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:21:33.311251 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-7962131e-b8b9-48ab-9601-b8e1741dca5c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:33.311880 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-7962131e-b8b9-48ab-9601-b8e1741dca5c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:33.318421 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7962131e-b8b9-48ab-9601-b8e1741dca5c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:33.318900 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7962131e-b8b9-48ab-9601-b8e1741dca5c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:33.319661 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7962131e-b8b9-48ab-9601-b8e1741dca5c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:33.320093 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-7962131e-b8b9-48ab-9601-b8e1741dca5c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:33.516360 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.policy [None req-7962131e-b8b9-48ab-9601-b8e1741dca5c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2f9826f53b44e1bbaf721d66de1356b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf87482b69e40dda5b8104e3e1b12e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117888) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 12:21:33.524674 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-7962131e-b8b9-48ab-9601-b8e1741dca5c tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 200 len: 1677 microversion: 2.1 time: 0.217471 Jun 28 12:21:33.525264 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 602/1184] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:21:33 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 12:21:33.902065 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-41970bf6-b0ec-4187-8d76-828615db9d16 req-cabec9f6-6b74-42f8-bd92-25f4ac952318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1515685b-eac4-46f1-a404-44701babc900", "name": "network-vif-deleted", "tag": "f56109ec-ba13-43bb-b6ad-537c1b281116"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 12:21:33.911302 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-41970bf6-b0ec-4187-8d76-828615db9d16 req-cabec9f6-6b74-42f8-bd92-25f4ac952318 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:33.911738 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-41970bf6-b0ec-4187-8d76-828615db9d16 req-cabec9f6-6b74-42f8-bd92-25f4ac952318 service nova] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:33.923531 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-41970bf6-b0ec-4187-8d76-828615db9d16 req-cabec9f6-6b74-42f8-bd92-25f4ac952318 service nova] Creating event network-vif-deleted:f56109ec-ba13-43bb-b6ad-537c1b281116 for instance 1515685b-eac4-46f1-a404-44701babc900 on hv-cinder-84795 Jun 28 12:21:33.929536 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-41970bf6-b0ec-4187-8d76-828615db9d16 req-cabec9f6-6b74-42f8-bd92-25f4ac952318 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031142 Jun 28 12:21:33.930669 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 583/1185] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Jun 28 12:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 12:21:34.542673 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b834d550-038a-442a-9df9-c546fd61daff tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:34.544084 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-b834d550-038a-442a-9df9-c546fd61daff tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:34.551539 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b834d550-038a-442a-9df9-c546fd61daff tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:34.551894 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b834d550-038a-442a-9df9-c546fd61daff tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:34.552652 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b834d550-038a-442a-9df9-c546fd61daff tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:34.553123 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-b834d550-038a-442a-9df9-c546fd61daff tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:34.569154 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-b834d550-038a-442a-9df9-c546fd61daff tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b834d550-038a-442a-9df9-c546fd61daff tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 HTTP/1.1 Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:21:34.570848 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:34.573126 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '1515685b-eac4-46f1-a404-44701babc900'} Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:21:34.574685 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:34.576578 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:34.578031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-b834d550-038a-442a-9df9-c546fd61daff tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:21:34.578031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-b834d550-038a-442a-9df9-c546fd61daff tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 404 len: 111 microversion: 2.1 time: 0.033715 Jun 28 12:21:34.578031 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 603/1186] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:21:34 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:21:34.586422 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0cb20542-ff8f-4eba-84dd-e673bca465f7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '.version_select at 0x7f39337b2e50>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:34.608114 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0cb20542-ff8f-4eba-84dd-e673bca465f7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579884352" status: 202 len: 0 microversion: 2.1 time: 0.029015 Jun 28 12:21:34.608725 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 584/1187] 10.222.0.55 () {58 vars in 1217 bytes} [Tue Jun 28 12:21:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579884352 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 12:21:36.401110 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2af63630-5526-4f95-bb6b-363261659b47 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:36.401765 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-2af63630-5526-4f95-bb6b-363261659b47 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:36.408860 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2af63630-5526-4f95-bb6b-363261659b47 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:36.409342 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2af63630-5526-4f95-bb6b-363261659b47 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:36.410112 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2af63630-5526-4f95-bb6b-363261659b47 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:36.410535 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-2af63630-5526-4f95-bb6b-363261659b47 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:36.424534 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-2af63630-5526-4f95-bb6b-363261659b47 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2af63630-5526-4f95-bb6b-363261659b47 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 HTTP/1.1 Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:21:36.426114 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:36.427885 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '1515685b-eac4-46f1-a404-44701babc900'} Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:21:36.428982 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:36.430836 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:36.432483 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-2af63630-5526-4f95-bb6b-363261659b47 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:21:36.432483 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-2af63630-5526-4f95-bb6b-363261659b47 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 404 len: 111 microversion: 2.1 time: 0.031344 Jun 28 12:21:36.432483 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 604/1188] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:21:36 2022] DELETE /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:21:36.436796 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9e2e271e-ef29-43b4-a3fb-5bbb5d88b0b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:36.437607 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9e2e271e-ef29-43b4-a3fb-5bbb5d88b0b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 1515685b-eac4-46f1-a404-44701babc900] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:36.444435 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e2e271e-ef29-43b4-a3fb-5bbb5d88b0b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:36.444892 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e2e271e-ef29-43b4-a3fb-5bbb5d88b0b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:36.445708 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e2e271e-ef29-43b4-a3fb-5bbb5d88b0b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:36.446147 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e2e271e-ef29-43b4-a3fb-5bbb5d88b0b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:36.460297 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-9e2e271e-ef29-43b4-a3fb-5bbb5d88b0b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9e2e271e-ef29-43b4-a3fb-5bbb5d88b0b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 HTTP/1.1 Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:21:36.461951 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:36.463632 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '1515685b-eac4-46f1-a404-44701babc900'} Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:21:36.464490 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. Jun 28 12:21:36.466145 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:36.467368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9e2e271e-ef29-43b4-a3fb-5bbb5d88b0b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance 1515685b-eac4-46f1-a404-44701babc900 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:21:36.467368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9e2e271e-ef29-43b4-a3fb-5bbb5d88b0b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900" status: 404 len: 111 microversion: 2.1 time: 0.031416 Jun 28 12:21:36.467368 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 585/1189] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:21:36 2022] GET /compute/v2.1/servers/1515685b-eac4-46f1-a404-44701babc900 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:21:37.617009 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d69ed509-5a65-4cae-a850-d2746ac72458 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:37.617536 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-d69ed509-5a65-4cae-a850-d2746ac72458 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:37.625573 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d69ed509-5a65-4cae-a850-d2746ac72458 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:37.626140 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d69ed509-5a65-4cae-a850-d2746ac72458 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:37.627123 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d69ed509-5a65-4cae-a850-d2746ac72458 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:37.627676 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-d69ed509-5a65-4cae-a850-d2746ac72458 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:37.644432 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-d69ed509-5a65-4cae-a850-d2746ac72458 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d69ed509-5a65-4cae-a850-d2746ac72458 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a HTTP/1.1 Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:21:37.646036 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:21:37.647580 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a'} Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:21:37.650821 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:21:37.652379 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.654016 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-d69ed509-5a65-4cae-a850-d2746ac72458 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:21:37.654016 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-d69ed509-5a65-4cae-a850-d2746ac72458 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 404 len: 111 microversion: 2.1 time: 0.034519 Jun 28 12:21:37.654016 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 605/1190] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:21:37 2022] DELETE /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:21:37.658190 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5ca82190-dc19-48a1-bfd9-107a13feb53b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:37.658898 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5ca82190-dc19-48a1-bfd9-107a13feb53b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:37.669029 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ca82190-dc19-48a1-bfd9-107a13feb53b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:37.669501 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ca82190-dc19-48a1-bfd9-107a13feb53b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:37.670271 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ca82190-dc19-48a1-bfd9-107a13feb53b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:37.670722 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ca82190-dc19-48a1-bfd9-107a13feb53b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:37.684416 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-5ca82190-dc19-48a1-bfd9-107a13feb53b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5ca82190-dc19-48a1-bfd9-107a13feb53b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a HTTP/1.1 Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:21:37.686040 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:21:37.687788 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a'} Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:21:37.688823 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. Jun 28 12:21:37.690446 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.691839 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5ca82190-dc19-48a1-bfd9-107a13feb53b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance 6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:21:37.691839 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5ca82190-dc19-48a1-bfd9-107a13feb53b tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a" status: 404 len: 111 microversion: 2.1 time: 0.035342 Jun 28 12:21:37.691839 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 586/1191] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:21:37 2022] GET /compute/v2.1/servers/6215b4d8-64d6-4d0c-b36c-94fe5fdc9f0a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:21:37.695858 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e760e6fd-327b-429e-a11b-ea2e908a3f1e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:37.696361 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-e760e6fd-327b-429e-a11b-ea2e908a3f1e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:37.703040 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e760e6fd-327b-429e-a11b-ea2e908a3f1e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:37.703490 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e760e6fd-327b-429e-a11b-ea2e908a3f1e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:37.704246 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e760e6fd-327b-429e-a11b-ea2e908a3f1e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:37.705386 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-e760e6fd-327b-429e-a11b-ea2e908a3f1e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:37.719493 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-e760e6fd-327b-429e-a11b-ea2e908a3f1e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e760e6fd-327b-429e-a11b-ea2e908a3f1e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 HTTP/1.1 Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:21:37.721141 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:21:37.722917 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': 'd34bd04f-17f4-401e-a0d3-0bdf9e21df19'} Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:21:37.724047 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:21:37.725708 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.727377 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-e760e6fd-327b-429e-a11b-ea2e908a3f1e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:21:37.727377 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-e760e6fd-327b-429e-a11b-ea2e908a3f1e tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 404 len: 111 microversion: 2.1 time: 0.030525 Jun 28 12:21:37.727377 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 606/1192] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:21:37 2022] DELETE /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 12:21:37.731008 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-89a19d0c-b88e-4a32-91aa-f997c3deeb99 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:37.731641 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-89a19d0c-b88e-4a32-91aa-f997c3deeb99 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: d34bd04f-17f4-401e-a0d3-0bdf9e21df19] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:37.737927 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89a19d0c-b88e-4a32-91aa-f997c3deeb99 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:37.738379 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89a19d0c-b88e-4a32-91aa-f997c3deeb99 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:37.739148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89a19d0c-b88e-4a32-91aa-f997c3deeb99 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:37.739582 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-89a19d0c-b88e-4a32-91aa-f997c3deeb99 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:37.753387 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-89a19d0c-b88e-4a32-91aa-f997c3deeb99 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-89a19d0c-b88e-4a32-91aa-f997c3deeb99 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 HTTP/1.1 Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:21:37.754806 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:21:37.756475 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': 'd34bd04f-17f4-401e-a0d3-0bdf9e21df19'} Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:21:37.757553 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. Jun 28 12:21:37.759148 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:37.760712 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-89a19d0c-b88e-4a32-91aa-f997c3deeb99 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance d34bd04f-17f4-401e-a0d3-0bdf9e21df19 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:21:37.760712 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-89a19d0c-b88e-4a32-91aa-f997c3deeb99 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19" status: 404 len: 111 microversion: 2.1 time: 0.029094 Jun 28 12:21:37.760712 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 587/1193] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:21:37 2022] GET /compute/v2.1/servers/d34bd04f-17f4-401e-a0d3-0bdf9e21df19 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:21:38.905078 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a1069403-cd6a-40f6-8b97-eaac6a2dd5bb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:38.905629 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.compute.api [None req-a1069403-cd6a-40f6-8b97-eaac6a2dd5bb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117888) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:38.912651 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a1069403-cd6a-40f6-8b97-eaac6a2dd5bb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:38.913123 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a1069403-cd6a-40f6-8b97-eaac6a2dd5bb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:38.913876 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a1069403-cd6a-40f6-8b97-eaac6a2dd5bb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:38.914304 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG oslo_concurrency.lockutils [None req-a1069403-cd6a-40f6-8b97-eaac6a2dd5bb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:38.933507 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.wsgi [None req-a1069403-cd6a-40f6-8b97-eaac6a2dd5bb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a1069403-cd6a-40f6-8b97-eaac6a2dd5bb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: request: DELETE /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 HTTP/1.1 Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept: application/json Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Accept-Encoding: identity Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Connection: close Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Length: 0 Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Content-Type: application/json Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Host: 10.222.0.55 Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Openstack-System-Scope: None Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: User-Agent: python-urllib3/1.26.9 Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Id: None Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Domain-Name: None Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Identity-Status: Confirmed Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Is-Admin-Project: True Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Id: default Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Domain-Name: Default Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Role: reader,member Jun 28 12:21:38.935709 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Roles: reader,member Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Id: default Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Domain-Name: Default Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: method: > Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: exception: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:21:38.937434 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: action_args: {'id': '023a3ea3-0028-4022-9f3f-0617a2b29e26'} Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: {{(pid=117888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:21:38.938280 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:21:38.939732 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: ERROR nova.api.openstack.wsgi Jun 28 12:21:38.941147 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: DEBUG nova.api.openstack.wsgi [None req-a1069403-cd6a-40f6-8b97-eaac6a2dd5bb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. {{(pid=117888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:21:38.941147 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO nova.api.openstack.requestlog [None req-a1069403-cd6a-40f6-8b97-eaac6a2dd5bb tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 404 len: 111 microversion: 2.1 time: 0.036539 Jun 28 12:21:38.941147 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: [pid: 117888|app: 0|req: 607/1194] 10.222.0.55 () {58 vars in 1238 bytes} [Tue Jun 28 12:21:38 2022] DELETE /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:21:38.946197 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-268bf309-b7fa-4250-9ac9-9ff76d9ce8b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 12:21:38.946816 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-268bf309-b7fa-4250-9ac9-9ff76d9ce8b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] [instance: 023a3ea3-0028-4022-9f3f-0617a2b29e26] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 12:21:38.954206 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-268bf309-b7fa-4250-9ac9-9ff76d9ce8b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:38.954655 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-268bf309-b7fa-4250-9ac9-9ff76d9ce8b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:38.955413 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-268bf309-b7fa-4250-9ac9-9ff76d9ce8b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 12:21:38.955846 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-268bf309-b7fa-4250-9ac9-9ff76d9ce8b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Lock "72c723ad-a447-476e-8f04-bf1a1e33d1d5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 12:21:38.969739 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-268bf309-b7fa-4250-9ac9-9ff76d9ce8b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] HTTP exception thrown: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-268bf309-b7fa-4250-9ac9-9ff76d9ce8b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Request method failure captured: Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 HTTP/1.1 Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Connection: close Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Host: 10.222.0.55 Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABiuvCrJZ1f5wEBaGYbq3VHmZWdTlR4myDuq-g6HDM-TVQJ7RxxCtiU5uXaW4kZA9j_YLiZaBpL80-twHTyRZ4i1VYTW3figho_G8ivw9g9WZzi22915hCrDPeMipQ36fKK1fdNd9y0MDTl3szGYIUds2Oq1e9BuMeoLAvSCvwzsWGxq-o Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Role: reader,member Jun 28 12:21:38.971284 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Roles: reader,member Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6cf87482b69e40dda5b8104e3e1b12e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6cf87482b69e40dda5b8104e3e1b12e8"}]}] Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 6cf87482b69e40dda5b8104e3e1b12e8 Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-208110076 Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Id: f2f9826f53b44e1bbaf721d66de1356b Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-208110076-project Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: method: > Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: exception: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:21:38.973078 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: action_args: {'id': '023a3ea3-0028-4022-9f3f-0617a2b29e26'} Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 12:21:38.974108 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. Jun 28 12:21:38.975666 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 28 12:21:38.977247 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-268bf309-b7fa-4250-9ac9-9ff76d9ce8b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] Returning 404 to user: Instance 023a3ea3-0028-4022-9f3f-0617a2b29e26 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 12:21:38.977247 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-268bf309-b7fa-4250-9ac9-9ff76d9ce8b7 tempest-AttachVolumeNegativeTest-208110076 tempest-AttachVolumeNegativeTest-208110076-project] 10.222.0.55 "GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26" status: 404 len: 111 microversion: 2.1 time: 0.030372 Jun 28 12:21:38.977247 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 588/1195] 10.222.0.55 () {58 vars in 1235 bytes} [Tue Jun 28 12:21:38 2022] GET /compute/v2.1/servers/023a3ea3-0028-4022-9f3f-0617a2b29e26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 12:22:54.387177 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:22:54.388137 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Tue Jun 28 12:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:22:58.472564 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:22:58.473300 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Tue Jun 28 12:22:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:24:08.856563 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:24:08.857638 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Tue Jun 28 12:24:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:24:42.080017 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:24:42.080017 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Tue Jun 28 12:24:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:24:53.833821 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:24:53.833821 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Tue Jun 28 12:24:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:26:14.400422 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:26:14.401095 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Tue Jun 28 12:26:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:26:18.482655 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:26:18.483532 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Tue Jun 28 12:26:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:26:37.133192 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:26:37.134398 dv-cinder-847954-1-iscsi devstack@n-api.service[117888]: Tue Jun 28 12:26:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:27:28.867229 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:27:28.867910 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Tue Jun 28 12:27:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:28:02.090696 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:28:02.091424 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Tue Jun 28 12:28:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 12:28:13.843596 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 12:28:13.844354 dv-cinder-847954-1-iscsi devstack@n-api.service[117889]: Tue Jun 28 12:28:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!